What rights do we allow to US citizens who practice murder?
Not all Muslims seek actively to murder non-Muslims. But all Muslims subscribe to a religion that justifies and even commands as a religious duty (an imperative that trumps the law of the state) the subjugation or murder of non-Muslims.
So what do you do? Nothing? That will probably work, and imperfectly, only so long as Muslims remain a minority in a non-Muslim country.
I do a lot of things, within the law, recognizing that Muslims have rights. Whatever legal precedent is set denying them their rights can later be used to deny me mine.
The Old Testament contains a number of passages calling for violence against homosexuals and adulterers. Do all Jews subscribe to those passages?
All Muslims are not as fanatical as you seem to believe.