Well, he fired all the heads of various churches and installed pro-Nazi men.
He allowed religion.
In that era, Stalin allowed religion a little bit too.