Some of these states have a higher mean age white population
That is actually true. Young people move away because they can't afford the cost of living, or can't buy houses, or there aren't jobs.