Nope, I disagree. The Constitution was given legitimacy by the states that ratified it. As far as slavery, there was something that was done and it was done legally.
So, it would be perfectly acceptable for the Constitution to deny anyone the right to life, liberty, and the pursuit of happiness?