See for example, Ervin L. Jordan, "Afro-Yankees and Black Confederates in Civil War Virginia," or the recent "Black Southerners in Gray" by Arthur Bergeron. These are not KKK tracts, but accepted, peer-reviewed scholarly books and articles.
There is nothing published by the two men you cited, either Ervin L Jordan Jr. or the late Arthur W. Bergeron, that suggests there were 100,000 black confederates, much less 10,000 armed fighters.
If you were familiar with either men's written work you'd know that.
Let them rave on that men shall know them mad....