Mt 19: 11-12 Not all can accept this.
He answered, "Not all can accept [this] word, but only those to whom that is granted.
Some are incapable of marriage because they were born so; some, because they were made so by others; some, because they have renounced marriage for the sake of the kingdom of heaven. Whoever can accept this ought to accept it."
They should just let them marry. It won't affect their ability to minister, and in fact, it may even have a positive impact on the sheer number of cases of sexual misconduct.
Besides, making babies is fun!