Of course not, they were betrothed! The actual marriage involved the bridegroom taking the bride home, which Joseph did AFTER Mary was with child, at the instructions of an angel.
So, did Joseph take his "marital rights" then?