Many parishes would envy the problem of logistics brought about by such attendance.
You did the right thing talking to the pastor. If the abuse continues, you might consider a kind, respectful, but firm letter to the bishop. Be sure to address the correspondence correctly if you want to be taken seriously. Be specific and don’t speculate as to the priest’s motivation. Just the facts. And again, be kind.
Thank you all for your replies and great advice.