He did have a right to it. It was his mining claim. It was his campsite next to his mining claim.
It was his de facto “living room”. And they roared into it and told him he had no right to it and they were going to leave in their own good time if at all.