How would he serve as Speaker AND be present for all of his current and future cases?
The House can rework the Federal Courts and he could pardon himself for the Federal stuff.