People have the right to go to the polls, get a ballot, and not mark it.
I guess my point is that there have always been minorities and powerless populations that have been managed by political machines, party bosses and mobsters. This intimidation has been accomplished with just such assertions of knowledge of the conduct of the suppressed.