That's wrong - the Canary islands are not and never were portuguese and they were populated by Iberian settlers WELL after the Reconquista was in control of much of Iberia (in the 1300s)
Then you change this to talk about California -- may be they are descended from the few Portuguese that lived in the Canary Islands, but going from the ancestry of people in California to making a leap about only true portuguese escaping the 8th century Muslim invasion in the Canary Islands is hilariously wrong.
.
The people frpm those islands self-identify as Portugese (whether you like it or not).