The simple fact that the male/female ratio is for all practical purposes one to one. is enough argument against polygamy. If few men have many wives, then many men hove no wives.
At the very least, it corrupts the gene pool as we see happening.
So then, why doesn’t someone set up a religion where one woman can have many husbands? That would balance the whole thing out.