Was it retained by the states or the people?
That is dependent upon how they choose to govern themselves via their respective State constitutions. What muddied those waters was the 14th Amendment, as we saw with the Kelo decision.