Jews in this country, and I assume in Hungary, are highly disproportionately represented as supporters and especially leaders in leftist groups.
Given this fact, there is more or less by definition going to be some spillover of criticism and hostility from group A to group B.
That is unfortunate, but if nearly all redheads were vocal supporters of right-wing causes, one would expect supporters of left-wing causes to develop some generalized dislike of redheads.
These are all things which existed before WWII and won't go away. European nationalism has a dark side which the Left tries mightily to identify the American Right with as well. But except for scattered groups like the Aryan Brotherhood and KKK (aka the militant arm of the pre-1970's Democratic Party) which any Conservative or Libertarian would completely disavow and despise, the shoe does not fit.