Free people shouldn't need a license to fly airline passengers, even if they are blind, right kid?
Free people should be allowed to drive the wrong way on one way streets, right?
Free people shouldn't need a permit to put a toxic dump in a residential neighborhood, right?!
< /KIDDING >
Look, most permits amount to little more than tax stamps. You pay your tax and you engage in your preferred activity.
Having to first go get a permit doesn't *forbid* you from doing most anything.
Thus, you are still free to do what you want, although the *manner* in which you do something might be regulated.
But that's a far cry from not being free.
You can drive to any location that you want, for instance, but you will do so by driving in the left lane and you won't go the wrong way down 1 way streets.
Ergo, yes you are free to drive to where ever you desire, but the *manner* in which you drive there is regulated.
Nonetheless, your freedom to go somewhere hasn't been forbidden, banned, or regulated away.