Mortgage interest rates haven't moved much in the past three weeks, but they are holding at a higher level than they've been for much of the year. That is taking its toll on borrowers who wish to refinance.

Total mortgage application volume decreased 0.2 percent last week on a seasonally adjusted basis from the previous week, according to the Mortgage Bankers Association.