This would be a tipping point, the tipping point for this country. All I can think of that would make him step down are serious illness in his wife or a child. If he had a early dementia or someting like that. Or blackmail.
I'm sorry ... BUT IMO none of the above mentioned is enough to destroy America over. He holds a position of responsibility that at this point in time that IMO supercedes ANY family concerns. He is an indespensable soldier on the front lines ... his removal would have disasterous consequences