That's the precise argument the intellectual giants on the left are fond of using.
Just goes to prove the old adage I guess. You lie down with dogs, you're gonna get fleas.