They're rich beyond taxes hurting them. They want that neighborhood to stay exclusive too.
I think more than a few of them get some sort of messiah complex too. They start believing God chose them to help the people or some such rot. I read an interview with Buffett, also a noted left-wingnut, and he made it sound like wealth accumulation meant he had a responsibility to better people in spite of themeselves.