The Jewish memory in question is of Christian anti-Semitism and the Nazi Holocaust. Even Jews who know little about either Jewish or Christian history know by high-school age that for nearly 2,000 years, Jewish communities suffered from anti-Semitic persecution at the hands of Christians, that Christians massacred Jews during the Crusades, that there was a Spanish Inquisition, and that the Holocaust came from Nazism, a far-right doctrine.Because of this deeply ingrained memory associating Jewish suffering with Christianity and the far right, most Jews have a primal fear of Christianity (and even of religion generally, including Judaism) and of conservatives. Jews therefore vote for the party that opposes the party associated with anything even remotely connected with public religion or the right.
The problem with these memories is not that they are inaccurate; it is that they are no longer accurate.
Republican's need to recognize that tolerance and defence of comments like Baker's put's a lie to these memories is not that they are inaccurate in many peoples mind.