Hover your drone over someone’s house, expect it to get shot down. Fly it in your own yard or in a public place.
The airspace above your property is public space under the law. You do NOT have the legal right to restrict the airspace above your property. If that was allowed, then aviation would not be able to operate. However, I do believe that there is room for compromise.
The current limits on drones allow for a maximum control distance (from transmitter to drone) of 400 feet if memory serves. Therefore, I would allow the home owner to restrict the first 50 feet of their property, and further restrict drone and other aircraft to a minimum altitude of 100 feet above any private property not owned by the drone operator. If the drone is within the 50 foot above private property, the property owner can take any steps necessary to disable the drone with no civil penalties. If the drone is between 50 and 100 feet, the home owner may take action but must cover the cost of repair or replacement of the drone. Beyond 100 feet the property owner is subject to a fine.
Right now there is a company running ads on TV to sell small drones with a camera and they specifically show it being used to video the neighbors and others...........very, very creepy!