This was reportedly Government Cut, a channel between South Beach and Fisher Island, long rock jetty, very choppy currents.
Your description does make it sound rather iffy. Not a good idea at all to be out there late at night. (it would seem to me)