There is a Greek word for cousins. It is used once but never describing the brothers and sisters of Jesus.
And Scripture identifies Jesus as Mary's FIRSTBORN son.
And I think that Luke, being a doctor, can differentiate between *firstborn* and *only*.