That may have been for the rich plantation owners, but not my ancestors, or the 'common folk' of the South. They were too poor to own slaves. They were probably right there in the fields with slaves, just trying to make a living.
What would you do if an occupying army invaded your land, slaughtered your cattle and swine, confiscated your crops, and burned your house down? If I would find myself in that situation, I would probably follow their example and take up arms.