Well, the First Amendment provides for it.
Freedom of Association is supposed to be party of the Constitution but white people are currently not allowed to declare their neighborhoods “for whites only”.