yes, but the issue here is - if Justice Souter robs a bank tommorrow, and the bag of cash is in his SCOTUS office, can the FBI enter it with a search warrant?
If Congress were to act as you describe - basically defunding every agency and court that sought to hold its members accountable for civilian crimes - then the entire government might as well collapse.
It seems to me too many on this thread are of the false impression that "checks and balances" involves "three separate but co-equal branches of government". Actually, it doesn't ~ just a logical division of labor. Congress clearly is superior to the other bodies (the courts and the President), and the States are obviously superior to the Congress itself.
Remember, in the United States sovereignty flows "up" from the people, not "down" from the state.
And yes, Congress does, in fact, leave folks high and dry who screw with them. Usually its hidden under the rubric of "porkbarrel projects", but think about it ~ the folks getting the "pork" and the folks not getting the "pork" are two different constituencies.
It simply does not flow in equal measure to the population ~ many are left out!
Sometimes the courts in an area not in favor will not get new buildings, or modern accoutrements.