(In-story, the insult probably meant to assert that the father was a drunk, but being said by a Frenchman, the point was that the reference was so obscure as to not really be insulting at all. Indeed, the silly person was the Frenchman who said it, not the Englishman who was being insulted; I was being silly, not insulting.)
Eff em if they can’t take a joke.