I would think it would make sense to get in the face of someone doing this. If they are holding a swastika, it is obvious they are a plant. Make sure the media only sees him getting harrassed for holding such an offensive symbol.
It might even be worth an assault charge to knock the guy out. I imagine the judge would go easy on a person who punches the guy with the swastika sign (if you even get caught at all).