The problem is...The Federal Government usurped the powers of the states very early on. The indian treaty law of 1790 is an example.
Not that the Constitution was followed all that closely. New York State figured out a way around it. They declared that the Oneida Indians, earstwhile American allies in the Revolutionary War, were, in fact, white folks, then argued that white folks couldn't own an Indian reserve. They then seized the land and sold it off to illegal aliens.
Not much different than the way things get handled these days.