Beauty is in the eye of the beholder. Guys go for women in the young-to-mid-20s over 35-and-up almost unanimously.
...if age doesn't matter, does that hold for men too? So that what Judge Roy Moore did (age 30-ish, asking out, with their mothers' permission, teenage girls) was nothing wrong?
See also the 30-something Jerry Seinfeld dating a teenage girl.
Men are designed to preferentially seek out the women who are most likely to bear healthy babies, and who have their most fertile years in front of them. That translates into women under 30.
Much of what we regard as "beauty" is really a set of indicators for female health, fitness, and youth. Yes, older guys do date older women, but how much of that is due to having to settle for what they can get?
It's not just one or two anecdotes, though.
Guys go for women in the young-to-mid-20s over 35-and-up almost unanimously.
No argument there.
...if age doesn't matter, does that hold for men too?
All I said was that it works for some couples. And we're not talking about a huge age gap or about adults dating teenagers.