Well, it doesn't help if you know some jerk threw a bottle of beer at a ref. But yes, most sports fans do not like Jim Gray, though occasionally he does provide some entertainment with an annoying question.
He possesses an arsenal of annoying questions, but perhaps the worst of the bunch is: "So, how do you feel right now?" (Said with his trademark whining tone and insipid smirk, of course). Asks that question in nearly every interview.