In Carter’s years the mortgage interest rates were past 21% and people still bought. My parents bought at 12% in 1979.
We shouldn’t confuse nominal rates with real rates (nominal minus the inflation rate).