Brought back childhood memories. We gathered buckets and buckets of walnuts.
Use a board with a hole in it to get the outer green skin off. Rubber gloves will keep the stain off your skin. Let the nuts dry in the sun for a couple of days. Do cover with screen to keep the squirrels from stealing your food. Don’t remember any worms.
growing up in the city i never did that; however, I did pick there was a non-edible chestnut tree nearby. It was good for climbing not eating.