Enforcement of the 14A resides in Congress and nowhere else.
Congress itself doesn't enforce the provision. It passes legislation providing for how it is to be enforced. No legislation means no enforcement.
If you have the power to do something you have the power to abstain. No one else receives that power in the vacuum created by Congress chosing not to act.