As you said, so long as it was mostly restricted to the homeless, the general public may not really care or pay attention. But it won’t stay that way for very long.
A lot of the homeless population are in fact employed, and anyway, the housed population passes them on sidewalks, in parks, subway stations, etc.
Not like there’s a bacteria shield protecting humans from one another.