Just because you wouldn't let the man use your bathroom doesn't mean everyone thinks like you.
My bathroom is open for business for anyone who really needs it -— including all of my bi-racial (black and chinese) grandchildren, French and Hispanic relatives, plus family rednecks and Crackers.
So better you keep your mouth closed and be thought a fool, rather than open it and erase any doubt.