I think you are on to something. If a conservative black were to run, he would probably get more blacks to vote for him than a white conservative, but still far less that a white or black leftist.
I don’t recall black support for Alan Keyes when he ran for offices or for other conservative blacks. They might be proud of them but I don’t recall it ever translating into a real shift in votes.