Are you in the very least bit familiar with Japanese immigration laws?
Very, and familiar enough to know that Japanese immigration laws do not dictate that foreigners must have private conversations in Japanese. Just as American immigration laws, enforced or otherwise, don't require private conversations in English only.