Polygamy means more than one wife. The other combinations you mention are not covered by that word.
I guess we need to come up with some new terms.