That is funny and quite witty.
Start speaking jibberish to him, a foreign language he's never heard. Then, typically start getting upset and angry, (wave your arms around too) when he doesn't understand. He'll just go to the next house, hoping they understand English.