You could quote Bilbo...
"I don't know half of you half as well as I should like; and I like less than half of you half as well as you deserve."
That would work especially well if you didn't like one of the families...