Except there were slave owners in the North as well.
Didn’t most everyone own slaves at one time. Even blacks. For certain Africa sold blacks.
But it’s the citizens of the twenty first century that are paying for it.