I think Rick likes that girl too much.
He should be focused on the new position, protecting the town, his children.
He’s probably been too amped up finding safe food, water and shelter for the kids to actually bond with the baby.
He sure as heck shouldn’t be thinking of seducing another man’s wife, breaking up a woman’s marriage.