It sort of sounds like it was a boarding house, not a homeless shelter?
Maybe the neighbors didn’t like living next door to a dozen bums.