I don’t have a problem with it, as long as it is Mary’s child.
The word "adelphos" in Greek means "brother" which can be from one or both parents. The idea is that St. James was Joseph's son from his previous marriage, which would make him really a stepbrother to Jesus, rather than a true half-brother, which is what I meant by "half-brother."