There nothing granting it, either, which means it is the state’s decision. A state deer license isn’t a federal issue.
I believe our Eastern Seaboard former British colonial territories have a quaint law that says the game on any particular piece of land belongs to the landowner, but their fishing laws are much more like Midwestern game control laws.
Then there the states without water, or many game animals, and I suspect they are owned by Bureau of Land Management!