Who said anything about giving them any rights?
Even if we could annex all of South America without even giving them the rights of a US territory like Puerto Rico, I would not want to do it. If America fails and becomes a corrupt tyranny, I want a place to run to.