That depends on whether I agree that the symbol has the meaning that the person that claims to be insulted attributes to it.
Some people claim that the Star of David is a symbol of "racist Zionism" and that it is justified to equate the Star of David with the Nazi swastika. I don't accept that.
Some people claim that "the American flag is a symbol of oppression and hatred, not patriotism and freedom". I don't accept that.
Some people, you being one of them, claim that the Battle Flag of the Army of Northern Virginia is a "symbol of slavery and racism". I don't accept that either.