Well, he did talk to them before he decided not to.
Or he actually did talk to them before he didn't. They must have just forgotten he did.