Your damn right i'd never vote for an adulterer.
I believe it takes more than a piece of paper to say a person is married or divorced. Rudy's marriage was already over when he was dating his current wife. I would argue in his heart whether or not he truly was committing adultry. In Gingrich's case though, adultry was just outright blatant.