When Switzerland shocked the world by dropping its peg of 1.20 Swiss francs per euro, it did real damage to the global respect of central banks, widely followed investor Dennis Gartman told CNBC Friday.

That's because the Swiss National Bank had just recently said it would stick by its peg far into the future, and just days later changed its mind, he said.