He is the one who said that unless we are baptized, we will not get to heaven - since infants are born into this world with sin, He (purposely?) left no proviso for infants.
He's also the one who said we must become like little children in order to enter the kingdom of Heaven. Incidentally, he also said made belief equally essential for salvation, but infants are unable to believe (or disbelieve) regardless of whether they've gotten wet.
But the reason I brought up Jesus is that He suffered physical death, which according to you means He was born with sin in Him.