By the 1830s, many of the 'black' slave owners were previously freed slaves who became prosperous enough to 'purchase' family members. But with changes in the laws in those Deep-south states, they were no longer allowed to free them. Therefor, they remained classified as slaves albeit owned by freed blacks.
I seriously doubt they were lashed for every transgression or their wives were raped on demand or their children were sold at auction when ever 'Master' damn well felt like it.
It is such hypocrisy that the Lost Cause zealots can somehow defend human slavery by constantly screaming that 'blacks owned slaves' too. So what's their point? Maybe 1/100 of 1%. That somehow makes it all better?
That is no justification for slavery, and a perverse twisting of the majority of the experience of black slave ownership which was overwhelmingly acts of compassion and family unity.
It makes them feeeeeeeel better about the fact that their ancestors started a war that cost 600,000 plus lives.
I selected two statements out of a lost cause rant to question and I researched the correct information. I was actually surprised that Ellison owned as many slaves as he did, but my feelings about this situation were exactly the same as yours.