Agreed. The average athletic male can only throw about 60-65mph. The average pro pitcher throws about 84. If you don't think it takes skill, try hitting a 97mph high hard one or a 88 mph slider.
Then go out in the field and run flat out toward the wall looking into the sun and catch a sphere the size of your fist hit from 370 feet way as it slices away from you.
Of the big three American sports I rate the greatest in need of athleticism to be Baseball, Football and Basketball. Football takes more brains. You have to learn multiple blocking assigments and defensive strategies. I might squeeze soccer in a head of basketball if it wasn't for the fact some players actually shoot outside 18 feet rather than dunk and that can be a trick shooting over someone 6'8" with a 37 inch vertical jump. All you need to play soccer is lungs and a sense of direction ( which kids don't get up until about 10 hence the confusion )
If you've never played baseball -- even slow-pitch softball -- you have no idea how miraculous Willie Mays' backwards basket catch was. I can't think of any more brilliant athletic play in all of sport.
Here is how I see it.
Basketball--most atheletic players of any kind. The only sport close to the endurance they exhibit is motocross.
Baseball--takes the most skill. Most men between the ages of 20 and 35 wouldn't even get the bat on a 70 mph pitch.
Football--requires the most physical strength and toughness.
Soccer--who cares. And I am NOT calling soccer gay.