It demeans the institution of marriage..
Adultery destroys far more marriages than homosexualtiy. Plus adultery made it into the top ten commandments, whereas gay sex didn't.
I think it's clear that to defend marriage adulterers, even those who only 'covet' outside their marriage, should be punished by the law in some way.
OR...we should keep the state out of the bedrooms of consenting adults.