IIRC is was Harry Belefonte (made famous by an ability to count bananas) who once referred to W's Secretary of State (Powell) as "the house negro" (or something along those lines).
Obviously Carson is also a "house negro" so *anything* said against him is fair game.