Meanwhile, the Wisconsin Republican explained the GOP budget plan would result in a $110 billion surplus in its 10th year. He added that Congress is trying to "pre-empt austerity" with gradual and phased-in entitlement reform. "I'm concerned about the entitlement explosion—the bankruptcy of these programs."
There are no immediate "hard core" cuts in the Republican budget, he said, and it contains pro-growth economics.
"These things kick in later on down the road," he said. "The kind of spending cuts we're talking about right now aren't even actually cutting spending. It's just slowing the growth of spending increases."
"You've had 'the sequester,' which just deals with a small part of government—about 2 percent of the spending overall," he added.
Ryan, the GOP vice presidential nominee in the 2012 election, acknowledged that the federal budget deficit has fallen faster than expected, with the Congressional Budget Office projecting $642 billion of red ink for fiscal year 2013.
(Read More: Shrinking US Deficit Reduces Pressure for Budget Deal)
He argued, however, that it is the result of a temporary rush of revenues. "Fannie [Mae] and Freddie [Mac] cut a check we didn't see coming by about $62 billion," Ryan said. "And go figure, capital gains [taxes] went from 15 percent to 23.8 [percent] and the people, their behavior adjusted to it—meaning they realized their gains in 2012."
The U.S. needs to get on par with the rest of the world on corporate taxes, Ryan also noted, saying that Republicans want to get U.S. corporate tax rates down from 35 percent.
The House Ways and Means Committee is drafting legislation, he said, "to make sure we have an international tax system that is in sync with the rest of the industrialized world." The average global corporate tax rate is 25 percent, he added.
Ryan said he wants to make it so U.S. companies can bring "money back when you make money overseas, so that you can reinvest it in America."