It's not wise to allow people to drive 18 wheeler trucks full of gasoline either, but we do. It's called "normal life". One of those driving into the lobby of that building and you would see serious carnage.
Just because the vehicle involved in this was an airplane lots of uneducated people panic. Get over it. Even in this case the thing hit a condo high rise and the only people killed were the airplane occupants. Same thing when the islamic idiot flew a Cessna into a building in Fla several years ago, killed himself and that's it.
During the Clinton administration another idiot (VRWC member, obviously) flew a Cessna into the grounds of the White House and killed just himself.
But let someone get out of control in a car and run into a crowd and you'll see some death and destruction. Little airplanes literally can't carry enough weight to be very dangerous.