If I may elaborate, its all in how you say it. There is a world of difference between saying "YOU HERETIC!" vs. "according to the beliefs of my church/denomination/religion, doctrine X is considered heretical". One is making a judgment and a declaration of absolute truth. The other is expressing an opinion.
Can't you just say "then IMHO YOU ARE A HERETIC" cutting to the chase and all.