A U.S. Federal Reserve rate hike in June or July wasn't set in stone, but labor data suggested it was time to pull the trigger, St. Louis Fed President James Bullard told CNBC.

"There's no reason to prejudge June," Bullard said, adding that the Federal Open Markets Committee would look at the data and decide then.