I understand your concern but what about people that can’t or shouldn’t drive.It gives a lot of freedom back to those who are homebound. Driverless cars won’t be mandated. At least in our lifetimes. I can see a time in the future where they might though. In a way travel is restricted already. You can’t get on an airplane without the govt. permission.
What you miss is that any travel at all is not a Constitutionally protected right. Our government has established that travel of any kind is a privilege that can be revoked for any number of reasons.
Automated transportation means that the government can and will control all movement. The days of jumping into the family car and driving cross country when you feel like it will be gone.
You, like others may think that self-driving cars will make life easier. They might, for a while. But like the story about boiling frogs, this is a gift we need to fight or freedom as we’ve known it is over.