Totally out of the question — the earliest man had no knowledge of his whereabouts or that there was even a larger world out there.
As foragers they likey traveled only as far as daylight would allow a roundtrip.
Again, unless the ones that stayed behind, hadn't chased the "foragers" away, in the first place.
Persecution still is an excellent motivator for abandoning known lands for newer ones.