Earning $100,000 per year is not “rich” by any reasonable definition. The average single family house costs in America over three times that amount. The median income for an American age 50 is $168,000. Unless you are earning it as interest, dividends, and rent on your $5 million in performing assets, you probably don’t have enough wealth to retire without depending on social security if you’ve never earned $100,000 per year.
I also think it’s safe to say that most of the respondents to that survey pay little or no federal income taxes.
The median income for an American age 50 is $168,000
That's not even close to being correct.