His response was to the reporter for saying it.
If he was talking TO the reporter he would not have used the pronoun "he"