You are correct.
Just a possibility. I've seen the uniforms of Audie Murphy, from World War II, and Confederate General Wheeler. They were both about the size of my 14-year-old daughter, about 5'2", maybe 110 pounds soaking wet.
There was a fluff in the filmmaking community when the recent movie of "Cold Mountain" used Romanian Army reservists as Civil War extras, but the producers pointed out that American reenactors are almost all too big, too old, too clean, and have too many teeth to be anything like realistic :-).