He promised to recuse, under oath, in front of Congress, before he took the job.
He was before Congress because he accepted the job. I’m guessing in his mind, he would have been admitting guilt if he quit at that point. He wasn’t guilty. He isn’t guilty of Russian collusion. Trump isn’t guilty of Russian collusion. The Swamp acts extremely guilty.