Not recorded. Thus nobody will ever know.
You are correct, nobody will ever know. But I bet those 2 million slaves tied to cotton production produced the vast majority of the cotton that was grown in the South.