Nothing is certain but death and taxes—and now, problems for victims of the IRS breach. Even consumers whose records weren't compromised may experience some short-term hassles.

The agency announced Tuesday that criminals used stolen data—including Social Security numbers, addresses and birth dates—to gain access to more than 100,000 taxpayers' past returns through the IRS Get Transcript application, which consumers typically use to obtain previous returns for mortgage and college loan applications. The breached records were used to file fraudulent tax returns, the IRS said, with nearly $50 million in refunds stolen before the agency spotted the problem earlier this month.