For one, since it's an IPO, it's probably overpriced, Barry James, president of James Advantage Fund, told CNBC.
"When you look at initial public offerings, 80 percent of them lose money the first year," he said in an interview with "Power Lunch."
"You have this hype that we have today and you have this weird kind of governance. … So we think let the froth die and then there might be a better time to buy."
That governance is what also concerns Mike Crofton, president and CEO, Philadelphia Trust Company.
"It is a strange structure and there are different accounting rules that are applicable in China that aren't necessarily compatible with our accounting rule," he told "Power Lunch."
Plus, the government of China is always somewhat suspect, he added.
"I'm not sure that the average American investor knows what he or she is getting into if they were to invest in Chinese companies," Crofton said.
After initially spiking almost 50 percent in its market debut, Alibaba shares fluctuated in volatile trading Friday and briefly dipped below the opening price of $92.50.