Good point, but the northward move would have also found richer and more moist soils (and the shorter growing season is partly compensated for by longer hours of daylight).
Another factor is the antipathy of hunters to those who farm land and consider it theirs.
Interestingly, farms tend to provide wildlife with food.
Whether that made the farmers welcome is unknown.