It’s quite simple. You have to consider the spirit of the law, not just its literal meaning. On the surface it may seem to be illegal to intimidate voters whatever their race, but the spirit of the law is to prevent harassment of voters from historically disenfranchised groups.