"This market is a very good market. And once we can get over this hump, we could have Prince," he said, making reference to the Prince song "Party Like It's 1999." The S&P 500 Index rose nearly 20 percent that year. (Read more: Fisher Says Fed Risks 'Hotel California' Monetary Policy).
Tepper said the credit markets aren't in a bubble, but they're rich right now.
Appaloosa is a powerhouse with $16 billion under management. This year, Appaloosa is said to be on pace for a 25 percent gain during a year that's been tough for hedge funds overall. The industry is up just 5.77 percent, according to Hedge Fund Research. The S&P 500, by comparison, has increased about 13 percent so far this year.
What Tepper says can move the markets. Case in point, the last time he was on "Squawk Box" in September of 2010, he made bullish comments about stocks, sparking what was dubbed "The Tepper Rally." Since then, the S&P 500 gained about 25 percent.
Turning to the economy, Tepper said during Monday's interview that it has some tailwinds behind it, but he questioned whether the U.S. Federal Reserve needs to "do anything more now" — referring to the central bank's bond buying program, which is projected to add about a trillion dollars a year to the Fed's balance sheet.