Maybe he didn’t consider a non-sexual affair (according to him) as a skeleton. It’s another matter not telling his wife, but that should be between him and his wife. And if Mrs. Cain has had enough, then, and only then, should he drop out.
As my father, the good reverend was fond of saying...."People are predictable and two plus two is, in my experience, always four."