According to self-made millionaire Grant Cardone, "millionaire is the new middle class." And a new survey from Charles Schwab reveals that many Americans may side with Cardone: Survey respondents say it takes an average of $1.1 million to be "financially comfortable."

But how many Americans are actually worth over $1 million and, therefore, "comfortable"?