It does not matter that many were slaveowners.
It does not matter that all of them were White.
It does not matter that all of them were Male.
It does not matter that it was written long ago...and that the writers and ratifiers of it are long dead.
It remains current law. If you want to change it there is an amending process. Just persuade enough of your fellow citizens as to the rightness of your cause that you can get an amendment passed by each house of Congress by a 2/3rds supermajority and then 3/4 of the states ratify it. Then you can have whatever changes you want. Its as simple as that.
But see, that takes work. Until recently they were content to work through the courts and let the judiciary rule and thereby issue de facto amendments without all the hassle of the traditional process. Now they see the judiciary turning so it’s The Constitution that must go.