Actually, I believe he said that he would have recorded it in his notes if LIBBY had said something to him and that didn't happen.
He said he "possibly" could have mentioned it to Libby, because it was on his list of questions to ask .....
If it was on his list of questions to ask, it is highly likely that he did do so.