Speakers who step down almost always resign from Congress as well. Hard to be a rank-and-file member after being Speaker and be fair to the new leadership. And probably no fun.
If only that were true about Pelousey...