I was talking about the Orkneys, not England proper. The article I was responding to said something about a "Viking" settlement built over a site previously populated by Picts & made the claim that the Vikings wiped out the Picts, which is very possible. The Picts were "pirates", so in my mind, there could have been back & forth between two different populations for generations on the Orkneys.
The Viking men did take women and children along when colonizing, but back & forth does seem likely.