They cut down all their trees, and so could no longer build boats. Which meant no fishing.
They could have reached the same fate just by going Woke and putting up No Fishing signs.