My family picked cotton in central Texas for over 100 years. We be white folks.
What? Think on this. The difference was that a white family were not slaves. It is not the cotton in itself, but the history of bondage for a people that it represented.