The one thing the property owner can do is not allow you to use pictures of his property to make money especially if his property is a good part of the overall picture.
He has no right whatsoever to tell you that you can not take pictures of his building, cars, etc. as long as you are off his property.
I know...he was so bent out of shape...I walked away realizing I had a guy with some issues on my hands..