If you move somewhere else besides NY. At 2% per annum that returns $200,000 per year, a nice living for sure, but that gives you a car and a mortgage, a fair upper middle class income. But wealthy you are not. You could spend $1M on a house and save the mortgage. It's a nice house in a nice neighborhood, but not "wealthy" and now you have $180K for all the other expenses. And inflation is running a lot more than 2%.
And yet, as of 2019, the average net worth for all American families was $746,820, and the median net worth was $121,760.
Few are “comfortable”.