You are correct. Most devout evangelical atheists, as I call them, are nothing more than anti-Christian. Logically, if they were truly atheistic, they would not care if anyone were Christian or practiced their belief openly.
"Evangelical" means good-news-bringing. I would call them "kakangelical"--bad-news-bringing--even though that's not a real word.