When you talk about the Catholic church "from the beginning" baptizing infants, do you mean the Roman Catholic church from the fourth century? Because we have documentation that shows many of the early church fathers DIDN'T hold to that. From https://www.christian-history.org/infant-baptism.html, we learn:
Ay, there's the rub. We know nothing, really, about whether the apostles baptized infants. For all the arguments and the supposedly clear statements of Scripture, there is no good and certain proof that infant baptism is or is not apostolic.
We know that Paul baptized the Philippian jailer's household and Peter baptized Cornelius' household. Did that include infants? If you think you know, then you're too confident. (Sorry, but you are.)
Those opposed to infant baptism argue that only believers should be baptized. That argument is valid, but it is not conclusive. The Scripture do talk about believing and being baptized, but that is not a strong enough argument to know that they didn't make exceptions for babies of believers. This is especially true since Paul compares baptism to circumcision, which was done to infants. Paul called baptism the circumcision of Christ, in Col. 2:11-12. Of course, some would deny this, saying that the reference to circumcision and baptism are separate there, even though I personally think the connection is obvious.
On the other hand, the historical evidence seems to lean very strongly in the favor of those against the baptism of infants. It doesn't seem that hard to put our finger on just when the practice arose, and it is not in the apostolic age.
When Did Infant Baptism Begin in the Church
We know that pretty much all churches were baptizing infants by the mid-3rd century. Hippolytus and Origen speak rather generally of infant baptism in the couple decades before 250, and Cyprian discusses on which day infants should be baptized, not whether they should be baptized:
Before the time of Origen and Hippolytus, it's much harder to know. No one speaks clearly of infant baptism in the 2nd century, for or against. However, Justin Martyr does give a reason for baptism that absolutely precludes infant baptism, and he says that the church in Rome received it from the apostles.
This quote is from approximately A.D. 155:
Here, Justin specifically contrasts water baptism with the lack of choice that we had as children, and he says that the apostles taught that this was the very reason for water baptism.
Infant baptism can't fulfill that purpose. In fact, it's contrary to it.
It is fascinating that Justin is part of the church in Rome! It's the Roman Catholic Church that says that infant baptism was taught since the time of the apostles. They even produce quotes from "early" church fathers to support it. Yet this, the earliest quote that could be applied to infant baptism, given in the city of Rome, is ignored! That is typical of Catholic apologists.
What about between A.D. 155 and A.D. 230 (or so)? Well, there we have two quotes to work from. One, from Irenaeus around the year 185, is almost certainly pro-infant baptism, and the other, from Tertullian around 210, addresses infant baptism directly and disagrees with it. Irenaeus, c. A.D. 185:
Note here that the term "born again" was synonymous with baptism to early Christians. That really didn't change until the time of the pietists in the 17th century. (Use the "Contact Me" button to the left if you can find a reliable, accurate reference to an original pre-17th century document that separates the term "born again" from baptism. I'd be happy to see it.)
For example, in the quote from Justin above, he mentions that "we" have been "regenerated" in the waters of baptism. "Regenerated" is just another way of saying born again.
Thus, by mentioning infants being born again, that's an almost certain reference to infant baptism from Irenaeus. I'm really never ready to make definitive statements, however, by inference. This is clear inference, but it's inference nonetheless.
Tertullian, c. A.D. 210: No inference here; he's very clear:
Well, that's clear. Tertullian was against infant baptism. So when exactly did infant baptism begin? It's hard to know for certain, but I suspect we will not be far off if we suggest that it began in the late 2nd century, gaining widespread acceptance by the mid 3rd century.
Infants and Sin
The argument of many would be that infants need to be baptized because of original sin. The Roman Catholic idea of original sin simply does not appear in the 2nd century writings of the church, which is one more argument that infant baptism wasn't widespread until the 3rd century. However, it is worth looking at the comments of the early Christians about infants and sin while we are touching on infant baptism.
Origen, between A.D. 225 and 250, clearly held to some idea of infants being tainted with sin:
These are good arguments for sin in infants, but there are answers to those who do not want to adopt a 3rd century view of the lack of innocence in infants. For example, the Scriptures also say that God has perfected praise in babes and sucklings (Ps. 8:2, LXX, as quoted by Jesus in Matt. 21:16). Also, in Ps. 58:3, one of the verses quoted by Origen, it is "the wicked" who go astray from the womb, not a general "they."
Earlier, though, I see no indication that Christians agreed with Origen. Obviously they did later, as the quotes from Cyprian indicated.
Here's Irenaeus, a half century before Origen, speaking of Herod's slaughter of the infants in Bethlehem. I love Irenaeus' perspective, who feels that those children were blessed as martyrs for Christ!
If that is not clear enough, he adds:
This sort of thinking is typical of 2nd century writers.
If you want to compare the Jewish rite of circumcision to baptism, then remember only little BOY babies were circumcised. There is NO documented evidence that the Apostles baptized infants and NOTHING from that time that suggests they did so. At least admit that.
Luke 18:1516 tells us that “they were bringing even infants” to Jesus; and he himself related this to the kingdom of God: “Let the children come to me
. . . for to such belongs the kingdom of God.”
When Baptists speak of “bringing someone to Jesus,” they mean leading him to faith. But Jesus says “even infants” can be “brought” to him. Even Baptists dont claim their practice of “dedicating” babies does this. The fact is, the Bible gives us no way of bringing anyone to Jesus apart from baptism.
Thus Peter declared, “Repent, and be baptized, every one of http://www.freerepublic.com/perl/pingsyou, in the name of Jesus Christ for the forgiveness of your sins; and you shall receive the gift of the Holy Spirit. For the promise is to you and to your children” (Acts 2:3839).
The apostolic Church baptized whole “households” (Acts 16:33; 1 Cor. 1:16), a term encompassing children and infants as well as servants
Read the rest of the article:
https://www.catholic.com/tract/early-teachings-on-infant-baptism