There was no full consensus on the doctrine of perpetual virginity within the early Church by the end of the second century, e.g. Tertullian (c.160 c.225) did not teach the doctrine (although he taught virgin birth), but Irenaeus (c.130 c.202) taught perpetual virginity, along with other Marian themes.[37] Origen (185-254) was emphatic on the issue of the brothers of Jesus, and stated that he believed them to have been the children of Joseph from a previous marriage.[45] However, wider support for the doctrine began to appear within the next century.[37]
https://en.wikipedia.org/wiki/Perpetual_virginity_of_Mary#Early_Church