It did not belong to them. The Government of South Carolina ceded the land that Sumter was built on in perpetuity to the Government of the United States. The Government lived up to its obligation and built Fort Sumter.
King Charles II gave Pennsylvania to William Penn. Once Pennsylvania declared Independence, It belonged to the people who lived there.