"Fed members went back and forth on the state of the economy with some agreeing that the drop in the unemployment rate is tinder for eventual inflation while others were less worried," wrote The Lindsey Group's Chief Market Analyst Peter Bookvar in an emailed statement.
On the data front, Wednesday saw factory orders for May fall by 0.8 percent, higher than expected 0.4 percent decline.
The much-anticipated release of last month's FOMC minutes is set for 2 p.m.
The minutes are from the June 14 meeting when the FOMC raised rates for a second time this year and revealed details on how it intends to gradually begin paring back its more than $4.5 trillion balance sheet. The markets have doubted the Fed will hike rates for a third time this year, giving just about 50 percent odds for a September rate rise.
Meantime, in oil markets, prices dropped on Wednesday, as another rise in OPEC supplies appeared to limit gains while geopolitical tensions in the Middle East and the Korean peninsula put a floor under prices.
Entering Wednesday's session, WTI prices had risen nearly 11 percent from a 10-month closing low over the course of eight sessions.
U.S. crude was around $45.05 a barrel, down 4.29 percent.
—CNBC's Patti Domm contributed to this report.