Excellent! Since you will be near Fredericksburg, perhaps stopping at his childhood home across the Rappahannock (the Ferry Farm) could also work. And in Fredericksburg, there is his mom's house (Mary Ball Washington, relative of Lucille Ball), the house he bought for her from General Hugh Mercer (whose Apothecary Shop is also in Fredericksburg).
Have a great time!
As a matter of fact, we do plan a stop at Ferry Farm. When we visited Mount Vernon about 2 years ago, we toured Fredericksburg quite a bit.
We saw Mary’s house and the apothecary shop. We also experienced a very well-done narrated tour aboard a bus.