"The Dollar Stores are now getting seriously squeezed by the competition from companies such as Wal-Mart, which has been taking share aggressively of late, as well as the drugstores like CVS and Walgreen's," he said.
"Meanwhile, after so many years of doing well, all of the dollar stores are now up against very difficult comparisons," Cramer added.
In addition, there's the end of the payroll tax holiday," he said. "This is something that's been dragging down all retailers, but I think it's especially bad for the dollar stores because higher payroll taxes hit low and middle-income consumers very hard."
Also, Cramer thinks Washington might not be done making things difficult for the dollar stores.
"With the debt ceiling fiasco and the negotiations over the budget sequester, it's possible we could see real cuts to entitlement programs in the next few months," Cramer said. That likely translates into less money from government programs for the poor, the main constituent of dollar stores."
Take all these negative catalysts together and Cramer thinks the dollar stores are facing serious headwinds.
"Considering the tough competition, the tough comparisons, and the higher payroll taxes on consumers, I think it's very hard to make the case that the dollar stores can be owned here," he said. "And I see no catalyst that can drive these stocks higher which makes buying them a big no-no."
However, that's not to say that Cramer doesn't see a play – he does.
"If you want to own something in this space, I say go with Five Below, a retailer where everything is five bucks or less," he said.
"Unlike the dollar stores, Five Below is a niche player—it caters to pre-teens at price points they can afford. The stock has shot up recently, so I wouldn't pull the trigger here but on a pullback I'd start a position. Make no mistake, this is the one to own," said Cramer.