I think the panthers and other big cats finish off many of them.
Raccoons, Coyotes, Bobcats and Alligators have all learned to hunt them. The Coons wait till they leave the nests and then bum rush the eggs. :)