Demonstrating an overall decline in casual dining, Darden Restaurants on Friday reported first-quarter earnings that were much lower than expected. It also announced major cuts, including job eliminations, Reuters reported.
Darden's holdings include the Olive Garden and Red Lobster chains.
"Darden in the most recent month was a little bit ahead of the industry, so it is a broader industry problem," Jeffrey Bernstein, senior restaurant analyst with Barclays, told CNBC.
In a conference call today, CEO Clarence Otis said Darden would cut costs by $25 million in the current fiscal year and $50 million in 2015, including laying off 85 support staff members, according to Reuters. Otis had stated in a release earlier that the sluggish recovery would continue to affect restaurant sales.
(Read more: Airport dining gets upgraded with high-profile names)
Matthew DiFrisco, director and senior restaurant analyst at Lazard Capital Markets, told CNBC that the decline of middle-class casual dining could be connected to an unstable housing market.
"I think with the volatility of the mortgage rates and also the frugalness of the consumer that [the] sector's very discretionary, and you saw some contraction there," DiFrisco said.
First-quarter earnings of 53 cents per share fell short of expectations by 17 cents, Reuters said. Net income from continuing operations fell to $70.2 million from $110.8 million, or 85 cents a share, in the year-earlier period.
Midday trade reports showed that Darden shares were down 5.5 percent, to $46.61.
Outside Darden's niche in casual dining, limited-service eateries that don't require tipping are gaining ground.
(Read more: Cramer: Has Chipotle got its mojo back?)
"I think you're seeing good strength, though, in brands like Chipotle. They're recovering and seeing some sales momentum," DiFrisco said. Starbucks, Dunkin' Donuts—they're all seeing some above historical same-store sales trends."