As I recall, Miles took a lot of heat from other blacks for playing with white musicians.
And it was not unusual at all for white musicians and black musicians to play in jazz together. Benny Goodman, Artie Shaw, Gene Krupa, and earlier bands were integrated. Duke Ellington hired Louis Bellson to replace his longtime drummer, he already had Juan Tizol, and would later have Paul Gonsalves. There were quite a few white musicians playing in hard bop.
So did Sly Stone.