You are correct. But the same can be said for illegals. If Hey are congregated in California, they won’t change the vote.
The illegals in California partially disenfranchise voters in other states because California will be accorded more congressional representatives.
Also, the illegals in California increase California’s Electoral College votes.