When visiting Paris, France for the first time it appears to be a conspiracy by everybody in the city to mock your French and pretend to not understand a thing you say. Once you figure out who is who and what is what you can get around fairly well and it becomes obvious the conspiracy was all in your own mind.
During my year of study in Paris, I did not notice anyone who could tell I wasn't French. Maybe you could use a phonetics coach.