I see all age groups playing - including often grandparents teaching their grandkids to play. It’s a way to have fun and get out and have a little exercise but doesn’t require great agility, practice, or athletic ability. No wonder it’s so popular!
The only downside is the noise - which if you’re in a public park you should expect. Some courts near residences are installing sound barriers to dampen the sound.
The sport can be played by people who don't have those athletic qualities you mention, but you won't win very much without them. Good, competitive games require a tremendous athletic ability. I have played with good players in their 20's and 30's who are top level athletes. It requires all those abilities you mention to be good at this sport.
Of course you can play with people who aren't as competitive, and it is still fun, and keeps you active. There is that side to it as well.