Actually licensing does not restrict your right to drive. It restricts where you may drive. You do not need license to drive on private property. You need a license to drive on government owned roads. The government is basically regulating the use of government resources. It is hard to see a constitutional issue in that.
Would you consent to a license to buy food? You can always grow your own.
Would you consent to a license to buy guns? You can always make your own.
Would you consent to a license to speech? You can always talk at home.
The government doesn't 'own' the roads, the public does.
Not to mention the legal definition of license IS governmental permission.