Technically incorrect. Arabs, the Ishmaelites that is, are half-Semite and half-Hamite if traced directly to Ishmael, and may be more Hamite than Semite considering Ishmael’s spouses.
Ishmael, a descendant of Arphaxas, a son of Shem, would himself have been a Semite, although his spouses may not have been. In any case, I rarely use the term anti-Semite. I prefer Judeophobe.