My guess is he’s good at being discreet with his sluts and his sluts were discreet too.
Republican politicians can be so good at being discreet Dem ops can’t catch them. Look at Thad Cochran for example
There's also the possibility that he's a good man and his wife is a loon. That happens too.