Or maybe he just doesn't like the effect this is having on his invalid wife. If the accusations are false he could easily decide it just isn't worth putting his wife through ever greater onslaughts which would be sure to come. That's just as plausible as your scenario.
Here on FR, usually when people are silent or don’t offer a defense, they are considered guilty.