That is the question you need to ask Thomas Jefferson who mischievously introduced this dichotomy into the American conscience.
Obviously no one agreed with him at the time, nor did he himself apply this idea to his own life.
As I recall the original Declaration of Independence did have language that all men would be free but the Continental Congress removed it so that the slave states would sign it.