Unless you have documentary proof this is slander.
He either did or he didn't. He is changing his story. Either way, that makes his a liar.