I believe Bedloe's Island, site of the Statue of Liberty, is in New Jersey.
National Park Service
1834
An interstate agreement between New York and New Jersey places Bedloe's Island (the land above low level water mark) within New York while New Jersey retains riparian rights to waters and all submerged land surrounding the island.
It was renamed Liberty Island in 1956. It is federally owned enclave.