I may be wrong, so someone jump in if this isn't the case ... colored people have mixed blood, they are not 100% negroid in origin. Personally I use, correctly or incorrectly, the terms black, colored, and high-yellow based on skin tone. Occasionally, I use other terms as well, but I won't use those terms on here.
If we want to be super accurate with respects to the true color of skin, brown is more accurate than black, is it not?