We know from Scripture that it is not simply the gospels, (Mt. 8:14) which it seems you are affirming Peter being married from, and I think his wife that he was leading a dead wife around on his ministry was quite alive.
"Have we not power to lead about a sister, a wife, as well as other apostles, and as the brethren of the Lord, and Cephas? " (1 Corinthians 9:5)
His wife, if she was still alive, was not at his side, when he was crucified upside down in the Coliseum.
As tradition has it, and would apply to all the other married apostles.
One only need look to paganism to understand where the idea for celibate priests comes from.