I would like to visit the Van Buren place in that area. It would be part of a trip in which I would also go and see Fort Ticonderoga, then the Van Buren in Kinderhook, and also the FDR library and museum in Hyde Park. Believe that the Vanderbilt mansion is also near to that area as well (would make for another interesting place to see).
As I remember, FDR and Frederick Vanderbilt were neighbors, though looking at the map, they were on opposite sides of the village of Hyde Park. Still, their mansions aren’t that far apart.
And it’s not far from where Geantvspent his final days. Area is rich in history.