I think a lot, if not most, feel he's not commie enough for them.
Two things that liberals of every age have is this certainty that they are smarter than everyone and always right, and this absolute loathing of being embarrassed.
They fear they were wrong about Joe, and he’s embarrassing the hell out of them.
It’s a perfect storm for their tender psyches.