McVeigh was not an atheist, and never claimed to be. He said he was agnostic. He received the Catholic last rites just before his execution.
Agnostic != Christian
Atheists believe in no god. Agnostics take the position that they can not know whether or not there is a God. Christians believe in God.
Because someone gives a guy Catholic last rites, that doesn't make the guy a Christian.