Perhaps would be encouragement to appoint others. Besides you’d have to lose all from a state to deprive it of representation. Someplace electing that many tools should face an consequence.
One thing about the House... terms are only 2 years so anyone being incarcerated for a felony is probably gone away at least until the next election. So that district loses its vote for the remainder of the term and has quite an interest in putting someone else in That position if they still locked up.