Ben Crump’s principle isn’t “freedom of association”, but simple racism.
It’s okay if it’s for black people, but not not if it’s for white people.
In that sense, he’s consistent.