Using that logic, we would have been two countries come around 1860 and black people wouldn't be voting in the South.
The lines are murkey, granted, and you shouldn't decide lightly, but you can't merely say all laws are absolute at all times. There are times where they become subordinate to other things.
No, the laws caught up with the needs of justice eventually. Or are you ready to let gays get married under the same premise as blacks not being able to vote?