No, it is not.
Paul calls James the Lord's brother.
"Is not this the carpenter, the son of Mary, the brother of James, and Joses, and of Juda, and Simon? and are not his sisters here with us? And they were offended at him" (Mk. 6:3 AV)
Two witnesses, both agreed. Same in DRB.