A Speaker may be removed at the will of the House, and a Speaker pro tempore appointed.
In fact it was Boehner who led a coup to replace Newt Gingrich...
The coup failed.
Then I shall stand corrected.