If the judges don’t feel they can be unbiased, or are frightened, they absolutely should be replaced.
I don't think your characterization that the judges can't be unbiased and/or are frightened is fair. The judges may be called as witnesses. I'd hope you can see why a person can't be both a witness and a judge in the same case.
Please recuse us from the resulting riots when the Soros plant is kicked out