Eh?
Was it an ad-lib?
No, it was scripted, but he thought that the line would not be perceived as funny because it was too creepy for a grown man to say that to a small boy.