Of course, it also would have been a sin for Mary to be pregnant without being married. So, obviously, we can assume God's plan for Mary must have been unique. Further, where in Scripture does it say Joseph demanded that "right?"
Where in scripture does it say he wouldn't?