Very little actually. Driving is just another repetitive task human have a habit of doing poorly that WILL be automated.
You are absolutely right. Just think of the benefits. The elderly who lose their right to drive will be mobile once again. ER visits for trauma will free-fall. Trial lawyers will no longer clog up courtrooms with bogus liability cliams. I can think of dozens more.