The U.S. does not have a tax policy that makes sense, former General Electric chairman and CEO Jack Welch told CNBC on Tuesday. Losing American corporations to overseas countries with lower corporate taxes would be a sin, he added.
Welch was interviewed on "Squawk Box" after being named No. 12 on the CNBC 25 list of the most influential men and women in business and finance since 1989, when CNBC started.
"We are giving away money ... because we don't have a rational tax policy," he said.
Read MoreBlame the US taxcode for Apple, Pfizer
In one example, New York-based Pfizer's bid to buy U.K. rival AstraZeneca—worth nearly $100 billion—could save the U.S. drug-maker billions in taxes because of its cash overseas. But if accepted, it could send the American company packing in search of lower corporate tax rates in Britain.
"I think we need to have a real national debate about our tax policy and what corporate taxes really mean. Who gets taxed when you tax a corporation? The consumer. The buyer," the former GE chief said.
"Corporations sweat. They cry. They bleed. They do all these things," he continued. "The idea that [companies] are just bricks and mortar is nonsense."
The recent trend of U.S. firms trying to buy foreign companies—in part for a tax benefit—can also be highlighted by General Electric's pursuit of French engineering group Alstom.
"Let's take the GE deal. They've got cash overseas. They're globalizing. The Alstom deal is a great fit," said Welch, who said that GE's relationship with France has always been strong and he's optimistic about a deal.
More on CNBC 25
Read MoreBuffett: This is huge for mom & pop investors
Read MoreThe last 25 years: What's changed, who mattered...
Read MoreHow we chose
Read MoreThe List
During Welch's 20 years at the helm, GE's market capitalization went from $14 billion to more than $410 billion.
Asked whether he'd put himself on the CNBC 25 list, the plain-talking Welch said: "Of course, I would … are you kidding me!" He also said he liked the top two picks—Apple's Steve Jobs and Microsoft's Bill Gates.
One name not on CNBC's list that Welch ruminated on was former Treasury Secretary Hank Paulson. "He was certainly a very pivotal figure in a moment in time where he was needed. I think he was a national hero for that period of time."
"Whether that's [worth] 25 years or 25 days," he continued, "I'll tell you for 25 days Hank Paulson was an important as anyone in this country" in keeping the economy on the rails during the 2008 financial crisis.
As a champion for businessmen and women worldwide, Welch preaches the gospel of his "Straight from the Gut" management style. He also serves as executive chairman of the Jack Welch Management Institute at Strayer University.
A major change he's seen in recent years: "Business is considered a grind now. We had a tough 2008 to 2013 period."
"Business isn't as much fun," he continued. "It is in Silicon Valley. It is in start-up. But it isn't in everyday life. What we've got to do is bring a lot of the fun back."
—By CNBC's Matthew J. Belvedere
