The housing market could crash even with continued population growth. Identifying a single dominant factor may be be an interesting exercise, however, both interest rates and population growth are factors. Another might be willingness of landowners to subdivide their parcel, to give up elbowroom in return for some temporary cash flow. Still another would be regional factors such as opening or closing of major employers. It's not simple, and it's not small in importance to the national economy.