Plosser, a noted hawk at the Federal Open Market Committee, expressed concerns over the unwinding of the central bank's asset purchases. The Fed has undergone three stages of quantitative easing (QE) since the finical crash of 2008 in an effort to increase liquidity and stimulate lending. Its bond purchases of $85 billion-a-month last year have been dialed back at recent policy meetings, with $65 billion added to the economy this month as the Fed proceeds towards the exit door.
"I am very worried about the potential for unintended consequences of all this action. And it's very difficult for us to know because we've never done this before," Plosser said, adding that the curbing of this extra liquidity in the global economy would be "very challenging".
(Read more: Jobs growth good enough to start taper—but not yet)
"Sometimes if you don't have Plan B, you don't have a plan," he warned.
Central banks across the world have followed the Fed's lead by injecting more cash into the system, with the Bank of England and the Bank of Japan both embarking on QE with benchmark interest rates at record lows. Plosser said that there is a lot of pressure on central banks around the globe and expectations of what these banks can do have risen to "unhealthy highs."
"I would lie to see over time, central banks to gradually pull themselves in to the background, because we are not the 'panacea,' we are not the 'silver bullet,' " he said.
(Read More: Bernanke's payday infirst post-Fed speech is... )
The current unwinding of the Fed's asset purchases has caused wobbles in emerging market currencies. U.S. investors that once searched the world for a high yield on their assets are now returning home in expectation of more normal monetary conditions.
On two different occasions, countries including Brazil, Turkey and India have seen weakness in their currencies with analysts claiming that the moderation of easy money as being a key reason.
Plosser said that monetary policy is primarily a domestic policy and problems and challenges arise when other countries decide to tie their monetary policy to another country in some form or fashion.
He added that Fed Chair Janet Yellen, and her predecessor Ben Bernanke, have managed to get this policy just right, stating that they should focus first and foremost on the U.S. economy.
"The best thing the U.S. can do for the global economy is have a strong economy itself...over the longer run that will make for a much healthily world economy," he said.
—By CNBC.com's Matt Clinch. Follow him on Twitter