IIRC, they paraded in NYC during WWII.
I doubt the Nazis paraded after Hitler declared war on the US. There was a huge German-American Bund rally in Madison Square Garden in 1939, while the US was still neutral.