Live beneath your means, rent a very cheap place and save the difference or double up with family and save the difference. You’ll have paid an amount equal to the original purchase price of the home before 15 years of a 30 year note is done anyway.
So, you’ll be living in reduced circumstance for a decade or more, but being payment free for the duration of outright ownership in order to avoid 30 years of payments, the first decade of which is very heavily interest and little principal, and ultimately paying twice as much for it over time, more or less.
Deferred gratification, it’s the way things used to be done.
I do get what you are saying and it would be easy in a state that had inexpensive housing. There is no way do do what you suggest in states like say California or New York.
However, we have zero debit beside the house and are selling in one year and buying a place for cash.
Longer than you are suggesting but a strategy worked for us.