Now, bankers and recruiters say even that is about to end. At a time when the U.S. is setting new records for the number of hedge funds, many pensions are cutting bait and giving up on the number of managers they invest with. That means that funds are suffering outflows as they cut fees to keep investors.
A disproportionately large portion of the banking industry is based in New York, lining up the city for a potential one-two punch of job cuts.
Recruiters see which jobs banks are keeping, and which are being automated away. It leads to some difficult conversations.
"I'm having to advise individuals that their brokering days may be over," said David McCormack, CEO of recruitment firm DMC Partners. "No one ever wants to hear it."
Automation is putting increasing pressure on wealth management roles and other high-paying Wall Street jobs, presenting an option for banks looking to streamline staff. Elsewhere in the industry, banks are hiring for tech roles in app development and regulatory and compliance jobs.
"Technology has taken over a lot of execution functions on the trading side," said Michael Karp, CEO of recruitment firm Options Group. "But more consolidation needs to happen."
Sometimes, workers who cycle out of Wall Street don't seek full-time employment.
"We are inundated with unsolicited reach-outs from candidates every day," said Kristen Koh Goldstein, founder and CEO of HireAthena, an online service that recruits part-time employees and working moms for back-office and human resources work. Koh said the volume of staffing candidates has picked up lately.
So far this year, banks including Citigroup, Bank of America and Goldman Sachs have cut staff as they fight to maintain profit levels.Big banks, including Goldman, have reshuffled their teams and moved some roles to cheaper ZIP codes, such as Salt Lake City. But, as one banker who spoke with CNBC pointed out, the U.K.'s Brexit vote and the potential it has to disrupt finance operations in London may help preserve New York jobs, at least in the short run.
Other recruiters note that there are some jobs on Wall Street that are likely to never go away.
"For M&A bankers, there will always be a boutique if you can advise and execute with clients," McCormack said.