Possibly more or less true of Mosby's men. But there were lots and lots of "partisans" fighting for the southern cause who were little more than bandits, notably in the border states. To be fair the same types "served" the Union cause.
Most officers in both armies considered them worse than worthless as fighters and a great deal more trouble than they were worth.
The movie Cold Mountain (Law/Kidman) and the series Hatfields and McCoys (Costner/Paxton) depicts men who didn’t go off to war but enjoyed throwing their weight around on the home front.
Yep, a lot of the `guerilla raiders’ were as much bandits and malingerers as soldiers, with lots of exceptions.