We do have a couple of older men who serve, mostly at daily mass but occasionally on Sundays. One problem is the altar server trainer is a woman who prefers girls because they are easier for her to deal with. Again, women’s work.
If your pastor is serious about liturgy, he needs to dump that lady.
I have mothers at my parish pleading with me to start a program of altar serving for their boys because they want this healthy male environment for them. My bottom line is that I will consider taking a boy only if the father or a suitable adult male surrogate comes with him. I want the men for lots of practical reasons, but above all I want them because they have to assume the position of spiritual leadership in their families — and they can’t do so until they are re-evangelized in a disciplined and structured way.