You're right about the abuse of slaves by American owners. It was far from widespread for exactly the reasons you cited. Many slaveholders were decent, compassionate people who simply took advantage of an institution they themselves had no part in creating.
It is ludicrous to judge 17th century people by 21st century standards.
The sugarcane leaves are sharp and cut you up. The slaves who worked the sugar plantations had it extra bad. But my white ancestors didn’t live any better than most slaves. 8 kids, one room shack, no electricity or plumbing... but they grew up strong and healthy, picking cotton in the Okla sun...