That tired old line is pure BS. If my taxes construct the roads, I sure as hell have a right to use them to go place to place.
You absolutely do have the right to "drive". The right to use the roads, the right of a person to go from place to place WITHOUT GOVERNMENT PERMISSION is an ancient right uder the common law of England.