Shake Shack shares closed just below $46 per share after pricing at $21. The company offered 5 million shares, and the volume brought "extreme squeezing to the upside," said trader Steve Grasso.
"I would be very careful in the next couple days and weeks," Grasso said.
Read MoreWhat's next for Shake Shack after monster IPO?
Investors should be wary of chasing the stock after it more than doubled in one day of trading, said trader Guy Adami. The stock could move to $60 per share or higher in the long term but looks less appealing now, he added.
"It's 'greater fools' theory and you don't want to be the last fool," Adami said.
Trader Brian Kelly would also stay away from Shake Shack in the short term, but added that "it's not a bad stock."
Read MoreBurger stock bull market beats market by double
Steve Grasso is long AAPL, BA, CLVS, EVGN, FB, GDX, GOOGL, IMMR, KBH, KDUS, MHY, MJNA, NVIV, PFE, POT, SO, T, TMUS, TWTR and YHOO. His firm is long USO, FCX, NE, NEM, OXY, RIG, VALE, MCD and KO. His kids are long EFG, EFA, EWJ, IJR and SPY.
Guy Adami is long CELG, EXAS and INTC. Guy Adami's wife, Linda Snow, works at Merck.
Brian Kelly is long BTC=, US Dollar, ZBH5, HYG puts, TWTR call spreads and BBRY call spreads. He is short EWA, EWG, EWQ, EWZ, EWH, EWW, HGH5, yen, Australian dollar, British pound, Canadian dollar, yuan and copper.
Tim Seymour is long AAPL, BAC, C, DIS, F, GE, GM, GOOGL, INTC, JCP, BX and SUNE. Tim's firm is long BABA, BIDU, CCU, DSKY, KNDI, MCD, NKE, NOK, SINA, SBUX, TSL and VIP.