True but so does a serial adulterer. Anyone with a secret to hide can be threatened by blackmail.
Adultery can be survived politically. We’ve seen several examples.
Outside of super socially liberal states (NY, MASS, CA) outing a politician ends his career.