That—not weather—is why mortgage applications to purchase have fallen more than 50 percent from a year ago and why existing sales have been down for four straight months, he said.
However, a UBS report issued Wednesday bore the headline, "Despite the decline in traffic, the shape of the recovery is unchanged," and it seemed to dismiss this month's 22.5 percent drop in prospective buyer traffic in new homes.
"We'd note that management teams have pointed out on recent earnings calls that community traffic has been solid in the early stages of the spring selling season," the UBS report said. "In turn, we continue to believe the recovery remains on track and look for the initial stages of the upturn to continue to unfold through 2014. That said, the pace of recovery is likely to remain uneven throughout the year."
(Read more: If investors bail on housing, what then?)
Home sales and construction usually slow in the winter, and this one has been particularly rough in some regions. That has led analysts to cry "foul weather" after each poor reading. From home sales to builder sentiment to today's 16 percent monthly drop in housing starts, it must be the snow.
"We've had an exaggerated seasonality this year," said Bill Pulte, a member of the founding family of Pulte Homes who now runs a private equity firm specializing in the housing industry.
The argument doesn't hold up entirely, though. For one thing, this has not been the harshest winter in history—not even close, according to a report from Trulia. In fact, housing starts in the Northeast jumped pretty dramatically: 62 percent seasonally adjusted and nearly 9 percent unadjusted. Housing starts dropped in the West, where weather was not a factor.
(Read more: Home builder sentiment index logs sharpest drop ever)
But, yes—one can blame the weather for poor starts in the Midwest.
"Last month was the 15th coldest in 120 years in terms of heating degree days," noted Patrick Newport of IHS Global Insight. "In the Midwest, the average temperature fell below zero. Most of the drop in starts, both single- and multifamily, occurred in the Midwest."
But a hesitancy is apparent everywhere. The few who turned up at a K. Hovnanian open house in Northern Virginia over President's Day weekend (the unofficial start of the spring season) seemed more to be kicking the tires than seriously considering buying.
Steven and Amanda Schneider, who have a growing family, were interested but not highly motivated.
(Read more: Beyond 'frozenomics': What's hurting the housing market)
"I think there is a small possibility we would buy in the next year," Amanda said. "It does feel like everything is thawing a bit right now."
—By CNBC's Diana Olick. Follow her on Twitter @Diana_Olick.