I think it was the bugs that decided it.
Plus the idea that nobody ever went into the Van Dam home at all, without being invited.