The pastor was foolish — and wrong — to take the law into his own hands. He could have gotten a restraining order against the neighbor and maybe gotten him convicted criminally.
The pastor would say that he said it, and the jerk would deny it. Over and over again.