The rally rich: Who gained the most from stocks
One answer he suggested would be a "coordinated way to reduce the workweek."
"Most people like working, but they'd also like to have more time with their family or to pursue their own interests," he said.
It's easy, of course, for a billionaire workaholic to say that we work too hard. But it turns out that even everyday millionaires, who you would think would preach the religion of long hours, think our work week should be shorter.
Read MoreAmericans say rich don't work harder
A survey by Spectrem Group found that more that 69 percent of millionaires surveyed (those with investible assets of $1 million or more) said they believed the four-day work week is a "valid idea."
Women were even more supportive—82 percent of female millionaires in the survey supported the idea of a four-day workweek.