Federal Reserve Chairman Ben Bernanke would not risk a premature withdrawl of the stimlus that has underpinned the U.S. economic recovery, former vice chairman of the Fed Alan Binder told CNBC.

In a testimony to Congress on Wednesday, Bernanke sounded a dovish tone, remarking that the premature tightening of monetary policy carries a "substantial risk" of slowing the economic recovery. But in an answer to a question from a congressional committee, he also said the central bank could start paring back purchases in a couple of months and these comments helped send U.S. stocks lower.