Because the only facts they were interested in learning was the alleged skin color of the participants.
The North is still reminding us of the Civil War, that they won it. Of course it was also them who kept free blacks out.