Exactly...If Mary and Joseph did not have sexual relations, they were never married...
Jewish culture does not have a cult of virginity. Cults of virginity were associated with Pagan cults. Hence the cult of Mary ever virgin is solely a Pagan cult. The Roman "church" has much pagan syncretism. Mary and Joseph were Jews in a Jewish culture.
shalom b'SHEM Yah'shua HaMashiach