By the way 94% of the people of the south did not own slaves
This is a misleading statistic. My dad, before he became ill, did a great deal of genealogical research on our family. In Georgia, Louisiana and Texas he says about one family in four or five had slaves. Meaning 20 or 25% of families had them. However as only the head of household owned them, and family's were large, people use numbers like this to cover the truth.
BTW before you start on me, some of my family were among the largest slave holders in the South.
When I was growing up we had one car. My mother didn't drive and the title to the car was in my father's name alone. So one could say that in the eyes of the state only 20% of the people in the family owned a car, but but the entire family benefitted from car ownership. Likewise with slavery. Only 6% owned slaves. But virtually all of that 6% had wives and children and, perhaps, extended family who gained benefit from the slave ownership. In some states the 1860 census indicates that upwards of half the families in some states held slaves. Many more families who did not no doubt drew economic benefit from those that did. So if it's hard to understand why people would fight so only 6% could own slaves, it's much easier to understand fighting to protect an institution that 50% or more drew benefit from.