If you go to Alexandria you can visit Fort Ward, which was one of the defensive forts around D.C. during the Civil War.
Mount Vernon is a great take as well.