That would be a terrible political move. If you want the guy removed, let him get dragged through the mud in a public spectacle so he begs to leave on his own terms.
That might explain why Rosenstein was all smiles when he left the White House the other day. He thought he had dodged.