The foundation of the religions, the holy books, of the Catholics, Jews, Mormons and 7th Day Adventists don't command them to kill those that are not them and enslave the rest by force of arms.
That would be the reason their civil liberties wouldn't be restricted.
Can the civil rights of Branch Davidians be restricted?