"Just because I don't care, doesn't mean I don't understand".
How about "It's not the pants that make you look fat, it's your ass".