There was a lot of independent people of high ideals in the South who overcame great hardships to even reach the US Army.
In contrast to the mass of more reluctant southerners conscripted into the Confederate army, these dedicated men did not desert in large numbers when the going got tough.
Most Union support in the South came from higher ground. Those areas provided most of what Republican votes there were during the era of the Solid South.