However, Gregory Daco, chief U.S. economist for Oxford Economics, believes a Brexit would be negative for the U.K. economy, as well as the EU economy.
"It might not have that much of an impact on the U.S. economy per se, but overall I think it would be a negative, especially in the short run," he told "Power Lunch."
"It would hamper trade. … It would also hamper investment."
The U.S. stock market will also not be immune to next week's vote.
David Seaburg, head of sales and trading for Cowen and Company, believes if the vote is to leave, the trade will be risk-off. If the vote is to leave, it will be risk-on.
"We're looking at a market right now that is teetering on, I'd say, a massive pullback either way," he said.
"If they vote to stay … the market's going to take off. It's going to ignite, it's going to be a risk-on sort of event that is going to be very short-lived."
Todd Colvin, senior vice president of global institutional sales at Ambrosino Brothers, said if the U.K. leaves, it will open Pandora's box a little bit.
"We're going to see bonds continue to rally. We'll probably see equities sell off and gold. Don't forget gold is out there
— it's been rallying very strong and that's been a great indicator for the risk-off trade."
So what should investors do to protect against a possible Brexit?
Robert Luna, CEO and chief investment officer for Surevest Wealth Management, would look at companies with little or no exposure to the EU. Specifically, he likes Amerco, Nordstrom and Travelers.
Mark Yusko, CEO and chief investment officer for Morgan Creek Capital Management, isn't betting on a leave vote, calling it "much ado about nothing."
However, if the U.K. did vote to leave, he would want to be very defensive in the United States and hold things like gold, gold miners and Treasuries, because things could get "ugly."
That said, even playing offense going into the vote could be "interesting," he added. He would look at European banks, as well as U.S. financials, since a stay vote would give the Federal Reserve the green light to discuss raising rates again.
Disclosures; Luna and his family own UHAL.