You’ve obviously never read Eusebius “History of the Church” which documents that Peter’s wife was martyred shortly before he was or 1st Timothy which says a Pastor should be the husband of one wife. There’s a better argument that a pastor must be married than that he must be celibate. Although I’m not going to go that far.
Again, even if his wife were alive, there is no evidence that they did not refrain from marital relations, as the Jewish priests did when they served in the Temple. Constancy in marriage was a precursor to the latter strict requirement for mandatory celibacy. As for 1 Timothy, if the Protestant interpretation for this were true, Paul would be disqualifying himself since he was unmarried. Rather it is a disqualification for those who were married multiple times and showed that they could not remain faithful to marriage or, alternatively, could not remain unmarried after the death of their first wife.