You should have the right to fly any rag you wish—Confederate flag, Nazi Flag, USSR Flag, Tea Party Flag, Any flag—its called Freedom—and the American Way.
Should / did Nazis in America have the right to wave the Swastika during WWII, when Germany was a sworn enemy of the US? At a time when traitors and spies could be executed for treason or espionage? I don’t know the answer.