Not at all. However, it is not uncommon for avowed racists to say what you did, as it becomes a sort of justification for their irrational hatred. The NAACP, La Raza, etc., are advocacy groups for the members of their otherwise underserved communities, nothing more.