The problem with adultery is it completely undermines the claim from a man, "You can trust me to do the right thing."
The answer in the mind of a voter is, "No, we can't trust you because your wife can't trust you and your duty to her is far, far greater than your duty to us as voters."
It almost makes one long for GA Jimmy’s “confession” that he had lusted “in his heart” instead of in Argentina!