You are right. It reminds me of the poster:
When they came for the Jews, I said nothing because I wasn't one; when they came for the gypsies, I said nothing because I wasn't one; when they came for the homosexuals, I said nothing because I wasn't one; when they came for me, there was nobody left to say anything...
I think it was Jonah Goldberg who observed that people who don’t have the intellectual firepower to defend themselves resort to questioning the motives of their opponents.