One of my GG Grandfathers fought with the G.A.R. in a Frederick County, MD regiment.
My wife had G Grandfather who fought with the G.A.R. in a Baltimore County MD regiment and survived Andersonville.
Roger Taney was widely reviled for the Dred Scott decision (and because he was a Catholic) but he remained on the Supreme Court until his death in 1864.