An "immigrant" is someone who comes here and wants to become American - i.e. learn the language, assimilate, etc. An invader wants to take over a land and remake it in his own country's image.
Since the southwestern US is gradually being transformed into a huge barrio or colonia, it's pretty clear which of the two terms applies here.
I’d be OK with calling them invaders or colonizers.