It’s clear to me.
He followed them home. Now they want to keep him.
They were unhappy when he went home. They’ll all be disappointed when the neighbors move, which will happen when their house is sold. The gentleman has already gone to his new job in northern Virginia, while the mom and baby are here until ... whenever.
They were good neighbors the last 4 years, except for their Rottweilers’ barking.