My grandparent’s generation said “colored” to be polite, and it was said without any slur or implication of inferiority (at least from my Methodist grandparents’ perspective).
But Stokely Carmichael described himself as “black” to sound more radical, and it stuck.