Not only do they have the power to remove justices they also have the power to establish and define the court's jurisdiction. Politician's today are too spineless and jaded to use their real power fro anything that might actually advance liberty.
It is a mistake to presume that Congress is not wielding their real power, they are, but they are letting the Court take the blame for it. Maybe the GOPe is not as dumb as you think.