Women are born with the only set of eggs they will ever have. Yes, age is going to make a difference in the viability of eggs and the children produced from them. Men produce new sperm all of the time which should not be affected by age if the man is healthy.
I think they go stale after a while. How in the world can they grow new healthy sperm when they can’t grow hair?