Even with mortgage rates hovering near record lows, it doesn't take much to send borrowers running for the hills.
A slight move up from 3.47 percent on the 30-year fixed to 3.50 percent, caused mortgage refinance applications to plummet 14 percent from the previous week, according to the Mortgage Bankers Association.
"Despite the Federal Reserve's announcement last week that it would purchase an additional $45 billion in Treasury securities per month as part of its continuing quantitative easing effort, rates increased in the second half of the week," said Mike Fratantoni, MBA's Vice President of Research and Economics.
"As a result, refinance applications dropped sharply to the lowest level in over a month."
Applications to buy a home also dropped 5 percent week-to-week, indicating a still weak and rate-sensitive purchase market. One third of buyers in today's housing market use all-cash. Many in the housing industry complain that it is not the rates but the availability of potential borrowers to obtain financing that is holding the market back from a more robust recovery.
The chairman of the National Association of Home builders says that while his cohort is feeling more confident about their business, "overly stringent lending standards" are holding back a more robust recovery.
(Read More: Housing Starts Fall as Sandy Slows Northeast)
Mortgage rates have been below 4 percent since May of 2012 and refinance volume has surged accordingly. Those refinances, many of them under the government's Home Affordable Refinance Program (HARP) for underwater borrowers, have helped to fuel consumer spending and have likely kept many borrowers from defaulting on their loans.
The big drop in refinances after such a small move up in rates indicates that the slightest move, up or down, can really change activity. The hope, of course, had been for rates to continue moving down.
"A lot of money has been spent between OT [Operation Twist] and QE3 for very little incremental reward," notes Peter Boockvar of Miller Tabak. "The true cost, yet to be determined, will of course occur when the likely market forced exit begins."
If mortgage rates rise markedly in 2013, the housing recovery will undoubtedly take a hit. The recovery in housing began with all-cash investors, but owner-occupants are quickly moving in.
"Fannie Mae, Freddie Mac and the FHA financed a record $31.2 billion in so-called conforming jumbo mortgages during the third quarter of 2012," according to a new Inside Mortgage Finance ranking and analysis. "Business in conforming jumbo loans – defined as mortgages on one-unit properties that exceed $417,000 – rose 29.6 percent from the second quarter and represented the highest quarterly volume for the agencies since emergency loan limits went into effect back in 2008."
Unfortunately many buyers are either too young or too forgetful to realize that mortgage rates are incredibly, historically low, despite slight moves up week-to-week. The good news is in the near term is that when some buyers see rates tick up, they jump into purchase more quickly, for fear the rates will keep going up.
—By CNBC's Diana Olick; Follow her on Twitter @Diana_Olick or on Facebook at facebook.com/DianaOlickCNBC
Questions? Comments? RealtyCheck@cnbc.com
