It’s not about black or white; it’s about violence.
Most whites have no—repeat, no—bias against “black” people (which as a category includes Africans, Caribbeans, etc.); but they do fear violence the “African-American” culture.
The left tries to conflate “race” with culture.
That’s because they don’t want to go anywhere near the idea that some cultures are indeed superior to others.
So, they shut down the exploration and debate of that concept by calling any and all who “go there”, “racist”.