They got their comeuppance two months later at Gettysburg and Vicksburg.
Because there weren't more of them.