Plenty of undeveloped areas in this world need labor.
Unrestricted movement will create a huge problem in that 80% of people would live in 20% on the countries, and leaving only the unproductive class behind in their countries. This is going to be a huge problem.
You could see from the caravan, when they were offered jobs in Mexico, they said it did not pay enough.