Pretty much, yes. They have right to free speech and freedom of religion...just as the people who put this up do:
No one from either side is going to put a gun to my head and tell me which church to go to (or not to go to). Which is good for them, since I'm very well armed.
You obviously disapprove of a fundamentalist approach that starts by insulting people? So when atheists do it, why condone it?