Nope. The marriage had not been consumated. Joseph still had the option to put Mary away without marrying her.
That’s why Mary was said to be pledged to be married. Their intent was to marry, and their obligation was to act as if married, but Joseph still had the option to call it off.
Deuteronomy 22:23-24
"If a man is discovered having relations with a woman who is married to another, both the man and the woman with whom he has had relations shall die. Thus shall you purge the evil from your midst. "If within the city a man comes upon a maiden who is betrothed, and has relations with her, you shall bring them both out to the gate of the city and there stone them to death: the girl because she did not cry out for help though she was in the city, and the man because he violated his neighbor's wife.
About as clear as it gets.
As I recall, an angel told Joseph NOT to call it off, as well.