The CSA had some excuses for poor conditions in its POW camps. The North had none. And the North treated black refugees fleeing slavery with savage indifference, and overt hostility, bordering on genocide. Those here who decry the deliberate devastation policies in the Shenandoah Valleys and elsewhere wouldn't know real evil if it kissed them. Read:
Sick from Freedom: African-American Illness and Suffering during the Civil War and Reconstruction by Jim Downs.
http://www.amazon.com/Sick-Freedom-African-American-Suffering-Reconstruction/dp/0199758727/ref=tmm_hrd_title_0
Disease was rife in any large assembly of soldiers or prisoners. Medical knowledge wasn't what it is today. Doctors were needed at the front and in medical hospitals. Heating cost and sanitation much money at a time when the army was the top priority.
Even with good heating, those who weren't accustomed to Northern climates would suffer. So far as I know, though, you didn't see men reduced to ragged skeletons in Northern prisoner of war camps as they were at Andersonville.
And the North treated black refugees fleeing slavery with savage indifference, and overt hostility, bordering on genocide.
Compared to what? Compared to slavery? Providing for thousands of runaway slaves can't have been easy. Still, they were fed and housed and even taught to read and write. I'd go easy with the "genocide" if I were you.