Because a Black woman wouldn’t put up with their nonsense.
I think you nailed it.
Men value having a woman who will put up with our nonsense, and who will give us minimal nonsense in return. A woman who is patient with our limitations and appreciative of what we give. The value of such a woman is greater than rubies, as Proverbs 31:10 explains.
Conversely, a woman who is the opposite of that, who does not put up with our foibles, yet expects us to put up with everything she dishes out, is of negative value. We'd rather do without a woman at all than live with such, as in Proverbs 25 "Better to live on a corner of the roof than share a house with a quarrelsome wife".
A woman who is unwilling to put up with any nonsense should accept that men will not stay with her longer than it takes to unload a deposit of sperm, if even that.