Fathers have a natural right to protect their daughters and sons between conception and birth.
If they aren’t man enough to actually marry the women with whom they have conceived said children, then I would argue they have no rights at all.