The media eats this stuff up -- when the guy is a Republican. Democrats largely get a pass because the wife will say something like "I love my husband" or "This made our marriage stronger" and the media will pat the Democrat on the head and say it's nobody's business anyway. Republicans can't get away so easily.
On a personal level, I recognize that people have failings, and I would try to get past it. On a political level? This guy is doing serious damage to the party, and the GOP should make it very clear that he needs to GO GO GO.