There are a couple of other relevant factors which may seem obvious but have not been mentioned. First, the farms are out in the country where there aren't many people, so they are mismatched to many of the sources of casual labor mentioned here. Unlike many businesses, one cannot move a farm to the inner city where jobless people are. Second, these are very seasonal, temporary jobs. The migrants would move from one area to the next to make a living. An apple picking gig, by itself, has limited appeal because it lasts a short time.
If illegal migrant workers are available, legal migrant workers will be available. They'll just cost more.