Not likely. The Hakkas (the guests) made a centuries long migration from north to south China. During that migration any of them with Caucasian features was executed. (for being barbarian)
Supposedly he killed all those with a large or high nose, and as a result the only surviving Hakka had short noses. This is an unsustainable Lamarckian view of inheritance.
The fact is the Hakka tend to not have a high bridge. Numerous Japanese people today, including many members of the Royal Family group do not have a high bridge. Many Ainu and those descended from Samurai do not have a high bridge.
Whatever happened to the Hakka who went from North to South is irrelevant to what happened to the Hakka who went to Japan "way back when".