From what I know, the blacks who have subsequently taken over SA arrived after the whites, to work in gold/diamond mines, etc.
If my understanding is wrong, I apologize.
All you say is correct.