Because if he is a "racist" then every person in the south is a racist. I don't agree with either one but that does not change the fact that by the standard set for Lott it applies to all of us.
BTW, that's not a fair thing to say; I'm about his age and I've NEVER hung out with the crowd he has hung out with.
Nor did my mother ever threatend to shoot the editor of the newspaper because he was posting articles in support of integration. And that wasn't a long time ago: that was in 1989.
I'm not a racist, nor or most of my friends. If you're going to use that line of defense, don't be surprised when it ends up with more conservatives mad at Lott then there are blacks mad at him.