Like it or not, when you evaluate Jews because of what a Jew does you're acting anti-Semitic unless you act similarly with all groups which would be a different ball of wax.
Neither you nor Frank Rich can have it both ways.
Rich claims to be writing this piece from a mainstream Jewish perspective. Therefore, he has set his views up as the voice of mainstream Jews, except the very few oddballs such as "that famous Talmudic scholar, Matt Drudge".
Why should you, he or anybody else be surprised his article is perceived by others as reflecting The Jewish View when that is Rich's intention when he penned it?
There are a good many Jews who fortunately aren't as irrational on this subject as Rich. One can only hope they will add their saner voices to the fray!