Some things you just don't say without expecting trouble, no matter how true they may be. Examples:
1) My mother made the same thing, only it tasted better;
2) Yes, honey, that dress DOES make you look fat; and
3) Women's brains are smaller than men's brains.
He didn't say men were smarter than women, only that men had larger brains.
Don't turn this into an uproar like the one that occurred after a D.C. official said the word "niggardly", which means stingy, and had to resign because some idiots thought it had something to do with the N-word.