Some founding fathers were slaveholders. The BoR was for white men. It was not unconstitutional until after a civil war and an amendment.
I don't see anything about "white men" in the BoR, but in some of the documents I see phrases like "All men are endowed etc."
What is the amendment written after the Civil War that you refer to? .....