If Johnson is ousted now, there have been 3 Republicans who have threatened to resign their seats immediately, which would give the Democrats the majority.
If the Democrats win the majority, then we lose control of the House committees that are investigating Biden and his Administration.
There is more at stake here than just the Speakership.