People have enough trouble driving in 2 dimensions.
Correct. Add to that the problems we are already experiencing with private drones violating FAA airspace restrictions on their operation: intruding above private property and flying well above maximum permitted altitude into the approaches to active commercial airports.
No, this is an avoidable problem. There are some inventions that are wonderful technical achievements that simply should not be in the hands of the general public no matter how wealthy they are.