The law works just fine hundreds of times every single day.
To take away the husband's rights is destructive to the idea of marriage.
Even in the context of long time adultery, and the husband having children with another woman? Is that really a marriage, in real terms? Isn't Michael Schiavo really married to the mother of his children in pracice, if not in law?