Fannie Mae Should Be Abolished: Barney Frank

Once a strong supporter of Fannie Mae and Freddie Mac, former Rep. Barney Frank now says they should be abolished.

Frank said he expects the government to come close to breakeven on the bailout of Fannie because of the increase in the housing market. "While they had some problems," Frank said of Fannie and Freddie, "there was an underlying value in the inventory that was going to reduce our losses.

Fannie Mae said Thursday it will pay the Treasury $59 billion by the end of this quarter, bringing its total tally of dividend payments to $95 billion.

(Read More: Fannie Mae: From Bailout Child to Government Cash Cow)

But Frank, a Massachusetts Democrat, no longer sees the need for these government-sponsored agencies.

"I had once been a strong supporter," Frank said. "But they should not have been this hybrid shareholder public sector operation."

"Clearly they should now be abolished," Frank told CNBC's "Power Lunch."

Once they're gone, Frank said, something will need to replace them. "They will be replaced by a mechanism whereby lenders who want to make 30-year fixed rate mortgages will be able to buy a form of federal insurance that will guard them against interest rates spikes," he said.

(Read More: April Jobs Aside, US Is Falling Behind)

Turning to the economy, Frank blamed the recent softness on the rise in the payroll tax and ongoing spending cuts.

"It is the wrong time now to be doing deficit reduction," Frank said. "I want to see deficit reduction. I want it to start a year from now. I want to be primarily in America's wildly over-extended overseas involvement."

By CNBC's Justin Menza. Follow him on Twitter @JustinMenza.