Turkish Riot Police Enter Istanbul's Taksim Square

Matt Clinch | CNBC

Turkish riot police fired water cannons and tear gas at anti-government protesters in Istanbul's Taksim Square on Tuesday, but the country's prime minister remained defiant.

Bulldozers removed barricades and police used water cannons against demonstrators, who were armed with rocks and fireworks. Skirmishes with the police continued into Tuesday evening, as hundreds of protesters remained in the square.

However, Prime Minister Tayyip Erdogan continued to condemn the protests in a televised speech.

"They say the prime minister is rough. So what was going to happen? Were we going to kneel down in front of these (people)?" he said. "If you call this roughness, I'm sorry, but this Tayyip Erdogan."

He added that the protests were a deliberate attempt to damage the country's economy and image, and accused speculators of profiting from Turkey's unrest.

"The increase in interest rates, the fall in the stock markets, the deterioration in the investment environment, the intimidation of investors — the efforts to distort Turkey's image have been put in place as a systematic project," he said.

Erdogan has also dismissed protesters as "capulcular", or riff-raff.

(Read More: Turkish PM Threatens to 'Choke' Foreign Speculators)

The protests and the government's reaction has sparked anxiety among foreign investors. So far, the protests have lasted for 12 days, with three people killed and about 5,000 injured.

On Tuesday, the Turkish lira weakened to 1.8955 against the dollar, its lowest level since December 2011, and down from 1.8706 on Friday. However, the lira strengthened slightly after the Turkish central bank said it would implement short-term monetary tightening measures to counter foreign exchange market volatility.

Matt Clinch | CNBC

David Bloom, global head of foreign exchange strategy at HSBC, told CNBC Europe's "Squawk Box" that emerging markets (EM) were once again viewed as a risky trade.

"EM is getting smoked at the moment," Bloom said. "South Africa and Turkey have put political risk back into EM and we've underestimated political risks. We all thought they're paying high yields because they like us - no, they're paying us high yields because you're taking risk."

(Read More: Turkey's Rulers Show They're No Good With a Crisis)

Timothy Ash, head of emerging markets research at Standard Bank, said the Turkish government's strategy appeared to be "fairly confrontational".

"If the idea is not to clear the square, then the aim seems to be to send a message to protesters that the authorities have the ability to clear the square at any time," Ash, told CNBC on Tuesday. "I guess this is to improve the negotiating position of Erdogan as he goes into a meeting tomorrow with representatives of the Gezi Park protesters."

(Read More: Emerging Markets See Biggest Exodus Since 2011)

Despite trading higher in the morning after better-than-expected first quarter gross domestic product data, the benchmark Turkish stock exchange closed more than 1.5 percent down.

(Read More: Can Turkey Become 'the China of Europe'?)

Reuters contributed reporting to this story.