The guy probably appreciated you arguing with him, after all, he was getting paid while you were arguing with him.
I did address canvassing and all one has to do is spot the location on the closest area outside of your property line. That is what he should done if you objected to him coming on your property.
He said that he had driven to the gate at our property line last week. That would have sufficed?