The issues facing retailers are "just too big," and those stocks should see more downside, the billionaire co-founder of Avenue Capital told CNBC on Wednesday.

"We're short retail," Marc Lasry said, declining to answer a direct question about whether he's short Sears. "I don't know if my compliance department will allow me to" say either way.