In the Carolinas if they don't have a job the young ones go home to live off their relatives like our kids would do here. Now if a guy is married with kids that might be a little different because they might be able to get government benefits. The young guys live with a bunch of their buddies. If they can't pay their way they are ousted from the nest pretty quick and they generally go home. With the drop in building and landscaping their ranks have really thinned out over the last coupe of years.
I know illegals swamped Charlotte in recent years due to the real estate construction boom, but that is over now.
I second your observation. There is a noticeable decline in their numbers in the past couple of years.