Go look up real estate values in Fairfax county and tell me what $500K gets you. Since I lived up there not too long ago I can tell you that it buys you a 20 year old house in Hernandez (Herndon). If you live in the District you have to pay for private school because no one with any smarts sends their kids to public school there.
None of that changes the fact that Congressmen and Senators make less, and most of them have to maintain two places of residence, unlike judges.
I can't see how someone with a $185,000 annual income can't make a $3-4k mortgage payment every month. Bear in mind that the vast majority of judges, especially the lower-paid district judges, live outside of Washington and do not face such home prices.