Life was hard and with no guarantee that there would be security or enough to eat for all.
Hunting, farming, fighting the elements, fighting wild animals, or fighting each other... men worked VERY hard just to keep everyone safe and fed.
WHY would a man want to struggle like that for children not his own?
Yet some men do, willingly. (just all the new ones better look like daddy!)