West Point was a military fort before the Revolutionary War. The School came later but was put there because it was already a military property.
But a class picture? Its not a big deal, but it just sounded like one of those myths that spread around.
I understand he gave up West Point to the Brits.