Solely because we refuse to fight back.
That is the truth of the matter.
FWIW. I have observed the change in public attitudes over the last fifty years. This is to digress, but as an example I know immigrants to Canada years ago tried to please and fit in. "Go back where you came from" could be heard if one said the wrong thing. Now new immigrants from certain hell holes are given refugee status. Some of them blatantly rant on against just about everything in Canada. Even dictate a change in regular practices. No one dares let out a peep.
What I am trying to say is this. The more aggressive, the more vociferous and in your face certain groups are the more people back off. These groups inner outrage possibly as to whom they are, is vented on otherwise reasonable citizens.
Something strange has happened in our society over the years.