What locals would see? The other islands, apart from the other St.James which Epstain also owned, seem quite far away. People would have to come close in boats to see what was going on.
St. Thomas is only 1.56 miles from Pedo Island and it can be seen clearly.
The boat traffic is huge in both island’s areas and something would be noticed. Quite a bit should have been noticed.