But Scott Hanson, senior partner and founding principal at Hanson McClain, told CNBC's "Brexit: Facing the Fallout" special report that investors should take a "step back and realize that if they have a balanced portfolio, not all their money is getting hammered in the stock markets."
He explained that even if a portfolio was 50 percent invested in stocks, there was still another 50 percent that was protected from the perceived volatility in the market. Despite the move in equities Monday, the CBOE Volatility Index fell more than 7 percent.
Hanson said, however, that money that was intended to be used within the next five years shouldn't be in stocks or other long-term investments at all.
Manisha Thakor of The Bam Alliance said that while was was difficult, "doing nothing is doing something — it's an active decision to stay put."
If investors felt that the current market action was "destroying" their retirement, that should be a red flag, according to Thakor.
"What that tells me is you either have the wrong asset allocation, an inappropriate level of of diversification or an inappropriate financial advisor who hasn't explained to you why doing nothing is the correct active action to be taking in a market like this," she said.