That's true now, but the half-siblings of Jesus were recognized for the first several hundred years of church history.
And then "miraculously" appeared "Mariolatry"?