Before the Civil War anyone with a farm had a slave or two who today would actually be considered farm help. I have a g-g-g-g-uncle who owned three black slaves. Even Native Americans had black slaves. Ben really ought to read a little more good history.
Blacks were usually enslaved by other blacks in Africa before being sent across the ocean.
Even blacks owned slaves. There were thousands of blacks who owned slaves.