Next up is military spending, which includes everything from salaries for the troops to new ships and fighter jets. That ate up about $160 of your $1,000—a smaller piece of the pie than last year.
The Treasury Department—which is in charge of collecting and accounting for all this money—takes about $100 for itself. The biggest chunk of that goes to pay interest on the national debt.
Read More How to file an extension on your taxes
After that the numbers start to get (relatively) smaller. Which is a good thing: You've got about $250 left to pay the rest of the government's expenses. The list includes Agriculture ($42 of your initial $1,000), Veterans Affairs ($37) and the Office of Personnel Management—the government's HR Dept. ($23). Next up are the departments of Labor ($22), Transportation ($21), Homeland Security, Civil Defense ($15), Housing and Urban Development ($15) and Education ($11).
That gets us into single digits the Departments of Justice ($8), Energy ($7), State ($7), Interior $3) and Commerce ($2). Last year, some $2 per $1,000 was spent by the National Science Foundation and on to general science and basic research. Another $5.50 went to pay for the space program.
And while some readers complain about seeing their tax dollars going to fund aid to other countries, it's not a big number. Last year, $5.33 per thousand went to pay for international assistance.
Not all of that money came from your incomes taxes, by the way. Last year, individual income taxes paid about $1.3 trillion of the $3.5 trillion in federal spending, while corporations paid $274 billion. The rest comes from Social Security taxes from both individual and employers ($887 billion); excises taxes ($84 billion); unemployment insurance ($57 billion); and other taxes. The Federal Reserve also kicked in $76 billion from the interest it earned on all the debt it's been snapping up since the 2008 financial crisis. (The rest was paid for with $680 billion in borrowed money.)
Your tax bill varies widely depending on which state you live in. Residents of Connecticut, with the second-highest per capita income, had the biggest federal tax liability—$13,672 per return, for the 2011 tax year, the latest data available. (Mississippi, with $4,228, was the lowest.)
But as your accountant will tell you, the tax code offers hundreds of ways to reduce that liability with deductions, exemptions, credits and other IRS voodoo.
Read MoreChances of getting audited by the IRS lowest in years
There must be some good tax accounts in the Nutmeg State, because they found the most deductions per return of any state. Even with those deductions, Connecticut taxpayers with the highest federal tax paid ($7,038 per return).
But Uncle Sam isn't the only government entity looking for a check. Tax rates vary widely—from a 12.9 percent rate in New York to just 6.9 percent in Wyoming. That doesn't include local taxes.
Mississippi residents paid the least in combined state and local taxes in 2011—just $2,620 per person, according to the Tax Foundation.
The highest? Once again, Connecticut takes the prize—at $7,150 in state and local taxes paid per person.