Buffett on the Fed, His IBM Stake and His First Tweet

Billionaire investor Warren Buffett told CNBC that if the Federal Reserve were to increase its massive bond-buying program that would be "pretty extraordinary."

In an interview that aired on "Squawk Box" Friday, the Berkshire Hathaway chairman and CEO said, "Basically [the Fed] is buying the debt we're creating and to go beyond that is an awfully big number."

After their latest meeting, Fed policymakers said Wednesday that interest rates will remain at historically low levels, while the central bank will not alter its $85 billion a month asset-purchasing program known as quantitative easing.

(Read More: CNBC Explains Quantitative Easing)

There was one notable change in the language used in the statement from the Fed—a declaration that it would increase or decrease the pace of its asset purchases depending on economic conditions.

Buffett said he thought that Fed Chairman Ben Bernanke "feels he needs a little help from elsewhere." In the past, Bernanke has urged Washington to reach a deal to reduce the nation's debt burden.

"But the economy is improving," Buffett stressed, "not [at] a very rapid clip, but this country has done well since 2008, certainly compared to much of the world."

It's going to be a big weekend for the so-called Oracle of Omaha. Tens of thousands of the faithful will make the yearly pilgrimage to Berkshire's hometown in Nebraska for the company's shareholder weekend—highlighted by Buffett fielding questions at Saturday's annual meeting.

(Read More: Berkshire Size, Buffett Age Cloud Annual Gathering)

Buffett's stock holdings are always in focus, and he talked about his stake in International Business Machines with CNBC. "I didn't buy more. I didn't sell any … I won't be a seller of IBM. I may be a buyer from time to time." He revealed, "I think we may have added a little bit this year in the first quarter. I'm pretty sure we have." (See Berkshire Hathaway's 15 biggest stock holdings.)

Meanwhile, the self-proclaimed, tech-phobic Buffett also made big news this week when he joined Twitter. His first tweet from @WarrenBuffett read, "Warren is in the house."

(Read More: @WarrenBuffett Joins Twitter—He's 'in the House')

Not surprisingly, he quickly attracted a big following. And as of Friday morning with only two tweets sent, he had over a quarter million followers.

Buffett sent his inaugural tweet during a live streaming video interview with Fortune to promote his editorial in the magazine.

Describing his Twitter experience so far to CNBC: "It's a terrific distribution medium. So I was very happy to go on to Twitter. Nothing bad has happened to me yet, either. I may try a cellphone one of these days."

(Programming note: Warren Buffett will be live with Becky Quick for three hours on Monday's "Squawk Box" from 6 a.m. ET to 9 a.m. ET. Microsoft's Bill Gates will join the conversation during the third hour.)

—By CNBC's Becky Quick and Matthew J. Belvedere. Follow them on Twitter at @beckyquickcnbc and @Matt_SquawkCNBC.