It is not quite as simple as you seem to think. I am a Roman Catholic practicing my faith in an Eastern Catholic Church. Our pastor is bi-ritual (Maronite and Latin) and celibate. Following the election of Benedict XVI, someone asked if he thought this pope might open the Latin Church to a married priesthood. His response was quite illuminating.
In a nutshell, he described the process in the Maronite Church for those married men who seek to become priests. It is quite lengthy and entails great scrutiny of the man, his wife, children and their marriage. There can be no room for scandal resulting from divorce. He went on to describe the challenges faced by the married priests, once assigned to parishes. Their wives and children are scrutinized by parishioners. Then there are the costs associated with supporting the priest and his family. Our pastor pointed to the number of parishes closing in this country from lack of funds. If the Church can't financially support a celibate priest, how could afford all the expenses needed for the wife and kids.
Recently, I posted a thread written by a Lutheran pastor who converted to the Catholic faith. He essentially supported the celibate priesthood, describing the times he couldn't attend the kids' concerts, sports games, etc. His family meant a lot to him and it was a tremendous challenge to divide his time between the needs of his parishioners and those of his family.
There's an old expression: "If it ain't broke, don't fix it".