The euro zone hasn't learnt from the collapse of Iceland's banking system, and the tiny island country no longer wants to join the group, Iceland's Prime Minister Sigmundur Davíð Gunnlaugsson told CNBC.

"The euro zone hasn't learnt the lessons Iceland was forced to learn," Gunnlaugsson said.