The fort and the ground it stands on was deeded to the federal government in perpetuity. It belongs to the federal government and it is up to the discretion of the federal government as to its determination, not the state.
And what 'federal property' would that be? That phrase is like 'government money'., there's no such thing. The federal government held property in trust for the collective States. It 'owned' nothing.