Nice try, but no. Being anti-semitic means being anti-Jewish. The fact that semite is the root word doesn't matter. Welcome to the English language where the definition of a word OFTEN DIFFERS FROM THE LITERAL SUM OF ITS ROOTS.
Everyone has a right to hold to and communicate disagreement with any particular religion. I oppose violence and mistreatment in general against anyone on the basis of their religion. I also oppose the pretense that being a member of a certain religion renders a person less culpable for their actions as an individual.