There is another factor
The land might have actually been purchased from the Bantu chiefs who surrendered title for some sort of compensation
That is what happened in the Eastern United States.
So, the land was not stolen
https://en.wikipedia.org/wiki/Great_Grant_Deed
Yes, my 18th-century Scots-Irish immigrant ancestor bought land in Virginia from a Bantu chief. Unfortunately the deed is in Swahili so I don't know what it says.