Activists aside, $300 billion CalPERS cited three main factors in its decision: "complexity, cost and the lack of ability to scale."
Observers focused on the difficulty CalPERS had in finding enough good hedge funds to take its huge sums of money as the most important reason. That, they said, means the decision won't have broader implications as CalPERS is the largest public pension plan in the country.
"The real reason I think CalPERS got out of hedge funds is the scale issue," said Sean Bill, investment program manager for the Santa Clara Valley Transportation Authority and the city of San Jose Police and Fire Retirement Plan.
Read MoreCalPERS hedge exit may be the first of many
The move has, however, prompted more questions.
"We got a lot of emails flooding in, saying, 'Geez, are we going to be still moving forward with these hedge funds as an asset class?'" Bill said.
But San Jose's pension managers buy into their hedge fund allocations, Bill said, and nothing is changing.
Hedge funds' relatively high fees are also being discussed in the wake of the CalPERS decision.
"The part of the conversation that really gained traction with our plans was the fee component of it," said Andrews, the San Jose pension manager, about the response to CalPERS' move. "(It's) something that our stakeholders are very acutely aware of."
Bill said one way for pensions to reduce fees is to hire internal trading teams, something common at large Canadian retirement systems like the Ontario Teachers' Pension Plan and Canada Pension Plan Investment Board. But that would take a legal change to be able to potentially pay public employees several million dollars for strong performance.
"If I was an advisor to (California Gov.) Jerry Brown ... I would say 'Look to Canada—Canada's got the model,'" Bill said.
Getting pension trustees comfortable with hedge funds is all the more important given the CalPERS announcement, according to observers.
"It's big news. You can't go into your quarterly investment meetings and ignore it," said Robert Christian, head of research at K2 Advisors and Franklin Templeton Solutions. "But asking questions doesn't mean there's going to be a mass exodus from hedge funds."
Christian added that the pensions he works with still believe in the asset class.
"Overall our clients still see the value of hedge funds and that they provide uncorrelated, risk-adjusted returns," he said. "Those are more and more valuable given where we are in the market cycle."