It was not just the SS that they looked down upon.
They also treated the Military personnel working at the White House like their personal slaves and gophers, not to mention demeaning the positions of butlers, maids, stewards, and official drivers by forcing the military to fulfill those functions.
Just to mention a few honest jobs they forever sullied.