Origen (182-251AD) "like that of a Gospel of Peter was of dubious recent appearance". Origen also noted that he shared with the notion that the brethren of the LORD were sons of Joseph by a former wife. In the same train of thought, he admits, while the notion might seem pious, it was not unlikely that the obvious interpretation of Scripture (that Mary bore them for Joseph) was true and acceptable.
That was the one I was remembering. Thank you! And Merry Christmas, wmfights!