I say if the rule is that no one but a member of a group can speak for, gesture for, or in any way represent that group, then the same should hold true for whites. Right now we are the only group as a race for whom every other group can tell is what our words really mean, what we're really thinking, etc. Everyone gets to tell us what we said and we what we meant, and they do parse it fine.
I was thinking the other day about how different the world would be without the European enlightenment, the global evangelization of the Judeo-Christian ethos of individual freedom, responsibility, and redemption, the industrial, communication, and medical revolutions, etc. All of these made possible a human population of nearly seven billion souls, most of whom live for a lifespan and at a level of relative comfort which a thousand years ago was the sole province of kings and nobles. Yet "we" are daily castigated as the creators of everything that is wrong in the world.
If one wished to see real bare bones racist attitudes in a modern venue go to Japan or China. Slavery? Make a stop in the Sudan or Saudi Arabia. The subjection of the female half of the human family? Almost any place outside the Western Hemisphere, Europe, and a few scattered remnants of European colonization which are wise and lucky enough to still be Capitalist (Singapore and Hong Kong come to mind). Was the European conquest of Planet Earth imperfect, bloody, and were great crimes committed? Of course. But if it had not occurred I would argue that the world would be a very different and to a large extent far worse place to be living at this moment in time.