A new Gallup poll asked Americans whether they approve of Bernanke's performance as Fed chairman. Only 40 percent approved, while 35 percent disapproved and 25 percent had no opinion.
But the poll is more revealing when the respondents are divided by income groups. Among those making less than $24,000 a year, 34 percent approved and 36 percent disapproved. The numbers were similar (36 percent and 34 percent respectively) for those making between $24,000 to $60,000.
(Read more: The top three myths about income inequality)
But among the highest income group measures—those making $90,000 or more a year—Bernanke was far more popular.
Fully 54 percent of those high earners approve of Bernanke's performance. Only 35 percent disapproved.
Of course, there could be many reasons why the top earners rate his performance higher. They may be better informed than the rest of the population. While 30 percent of the lowest income respondents had "no opinion" about Bernanke, only 11 percent of the top income group had no opinion.
(Read more: Are the 1% starting to overreact?)
And just because those at the top rate his performance highest doesn't mean he helped them most. Surely the Fed never intended its policy to increase inequality. Janet Yellen and others argue that Fed policy has helped all of America, especially through the housing market.