Well, if he hadn’t, then Jesus wouldn’t have had brothers and sisters. You can call them cousins all you want, but the bible clals them brothers and sisters. That’s good enough for me in my no spin zone theology.
You're not concerned with the Bible as much as you are concerned with what others have told you to believe. Traditions of Men.