The baby had done NOTHING! This evil man was angry at the child's mother, apparently whom he had never married. Maybe he didn't even consider the child as his own. He was just mad at the woman and she wasn't there, so he took it out on the child.
I don't understand why on earth this woman would leave her son with this man, natural father or no, if he'd been physically abusive to her in the past!