Except that in many (most?) cases the judge is a federal judge who has a lifetime appointment.
They could be arrested and charged with judicial misconduct.