Barry James, president and portfolio manager of James Advantage Funds, told CNBC’s “Power Lunch” that the subprime mortgage sector will continue to roil the stock market despite Wednesday’s rally.

“When a bubble bursts, you typically get one down leg, then a rebound followed by a worse down leg,” James said Thursday. “I think we’re setting up for that worse down leg in the housing market.”