My former boss was fluent and worked in Japan for many years, but he definitely looked like a gaijin. Big guy, balding, wire-rimmed glasses, blue eyes.
He was at a baseball game, and there were a couple of guys behind him talking about him in Japanese. He said they were discussing loudly how disgusting he looked, and how revolting he smelled.
He said he turned around to them and said in the most polite, sincere, and subservient tone, that he was sincerely sorry for ruining their atmosphere at the game, and would be happy to move to another seat.
He said they were flabbergasted and couldn’t utter a word, then they looked completely shamed.
The Japanese are notoriously and easily the most xenophobic country among the top economic producers.