I think a short answer is that he was offended
To be called an atheist, he believed in a creator,
and did not believe in an afterlife.
"I believe in Spinoza's God, who reveals himself in the harmony of all that exists, not in a God who concerns himself with the fate and the doings of mankind." -- Albert Einstein