I understand your concern, but we do not have to allow a violent religion to spew its spew. If worshipers kill in the name of God, this action does not have to be accepted by any people.
If those worshiping Allah, wish to pray in peace and not harm any person, then I say they have the right to do so. They must be stopped when they wish to kill the infidel though.