I have lived with a woman outside of wedlock but would never have started a family that way.
It would not be wise.