There are a lot of pre-fab and modular housing designs that can be pre-fabbed room by room, floor by floor, design by design. A great deal of semi-skilled labor can be eliminated from home building but obviously not all of it.
The thing is as more demands are made on labor wages by artificial (Government.) means the more this stuff will come to market and forever change economic sectors where it isn’t now a concern.
I was thinking about that too. There are ways to cut back on the labor required, way back - but the houses won’t be the same as can be built today as you’re limited by what you can ship.
But maybe backing off of McMansions and the wannabes is a good thing for the country?