Many constitutional originalists believe exactly that. And if you strongly believe in the Constitution, isn't that exactly where your baseline beliefs must begin?
Take for example the definition of "natural born" as originally intended in the Constitution, which would have denied Ted Cruz from being a candidate for President. Did Levin support that original interpretation, that has never been modified via Amendment, nor other law that changed the definition of "natural born"? No, he threw that to the wind, in order to support Cruz, when many constitutional originalists know that by the Constitution Cruz isn't actually eligible.