Except that the Army troops were under the command of William Anderson, not Abner Doubleday. And Sumter was built on land deeded to the Federal government free and clear by act of the South Carolina legislature. So your Governor's Island comparison doesn't work.
Except that the Army troops were under the command of William Anderson
Actually that would be Major Robert Anderson.