You're comparing what in effect is little more than flying a kite to commercial passenger service. If a drone crashes you just go to Radio Shack and buy another. But both in terms of regulation and operation, it's (more than) a bit more complicated than that when there might be dead bodies in the wreckage.
The technology is somewhat more complicated, but not particularly so. If your tire falls off your car at 70 mph you could well die in the crash. If the right series of things goes wrong in an elevator, you will be dead. A bridge could collapse while you are on it. Most things that could go wrong in a drone plane would probably be just as bad with a pilot.
I think I could trust a pilotless drone flying between two rooftops more than I would trust a driverless bus on a highway.
OTOH, I am still amazed at those scooters that manage to keep you upright on two wheels.