New York Fed President Bill Dudley, in an exclusive CNBC interview, argued that the decision by the Federal Reserve not to reduce its stimulus to the economy at it last meeting should not have surprised markets and that a taper is still possible later this year.

He said the decision by the rate-setting Federal Open Market Committee not to taper its quantitative easing was "completely consistent" with guidance the Fed gave publicly in June.