This went virtually unchallenged until the reformation.
Try and find an Early Church Father who denied this? Actual writing,not someones interpretation of them
The early RCC church and church fathers did not require priests to be unmarried and celibate, did they? Were they wrong on that matter? Can't pick and choose. They were generally good, but fallible men.
No doubt, apostasy within the Church came very early in Church history. Thank God for the true remnant that remained faithful.