Yes, that matches what I've read of the Virginia blacks "drafted" into the Confederate army. Indeed, the CSA Congress debated the issue from 1864 onward and steadfastly refused to arm blacks.
Many neo-Cofederates count as black rebel troops slaves who dug latrines, drove carts, and so forth for their rebel masters.