He said it at a private fundraiser. I have heard the comment, as innocuous as it was.
Then it is easy to say that he said it.