Seriously there must be a time both are gone and with proper ownership papers the legal owner can access the property. Sheriff, or somebody should be able to assist somehow so that if squatters return they are turned away or carted off.
Some states practically encourage squatters unless they squat on the property of the elites