Most died from disease in any case. I have seen 620,000 as the number of Union dead. Southern dead were a smaller number.
"In all, around 360,000 Union soldiers died as a direct result of the war. The Confederacy lost 260,000 dead."
Civil War; Library of Congress