Anthony Johnson (1600-1670) comes to mind. In fact, he was the first slaveholder in the colonies.
Yup. And some of his slaves were white.