Market reaction consequently was fairly muted despite the seeming discontent among Fed board members, with the stock market continuing its dizzying 2013 rally. Bond yields actually fell amid a tame safe-haven bid, with the benchmark 10-year note rate at 1.78 percent.
(Check the latest stock market action here.)
The release of the minutes comes as Wall Street tries to anticipate when the Fed will begin scaling back its asset-buying program, known as quantitative easing.
Under the latest version of QE, the central bank is buying $85 billion a month in Treasurys and mortgage-backed securities, while critics warn of potential asset bubbles and inflation problems.
(Read More: Pimco's Gross Turns Bullish on US Treasurys)
This month's minutes were released earlier than anticipated due to an error at the Fed in which the minutes were emailed inadvertently.
The comments as reported in the minutes reflect some of the strongest misgivings yet about Fed policy.
Members indicated a general tone that the moves have been necessary to stabilize the economy following the financial crisis that began in 2008.
The Fed aggressively drove down interest rates to the point where mortgage borrowing hit historic lows. At the same time, the stock market has soared, sending both the Dow Jones Industrial Average and the S&P 500 have hit record highs.
The Fed has tied its rate policy to a 6.5 percent unemployment rate and 2.5 percent inflation level, neither of which appears attainable anytime soon, particularly considering the anemic 88,000 job gain in March.
(Read More: Forever Fed: Jobs Blues Sets Up Eternal Easing)
But some also said that the costs are escalating the longer the program continues.
"A number of participants remained concerned about the potential for financial stability risks to build," the minutes said.
The discussions also provided a clearer path for how the Fed intends to unwind its $3.2 trillion balance sheet, though an exit from the zero interest rate policy remains less clear.
At least as far as the $1.1 trillion mortgage-backed securities portion is concerned, the Fed is unlikely to sell those back into the marketplace, opting instead to hold that debt to duration. Members felt that would minimize marketplace disruptions.
"A few participants noted that curtailing the purchase program was the most direct way to mitigate the costs and risks," the minutes said.
That reflected a growing sentiment that the best way to manage policy risks was to stop.
"A few participants noted that they already viewed the costs as likely outweighing the benefits and so would like to bring the program to a close relatively soon," the minutes said. "A few others saw the risks as increasing fairly quickly with the size of the Federal Reserve's balance sheet and judged that the pace of purchases would likely need to be reduced before long."
Nevertheless, the final vote saw only dissent, coming from Esther L. George, while the other 11 members affirmed the policy statement.
—By CNBC's Jeff Cox. Follow him on Twitter