After that first violent contact, they often settled down and adapted to the surroundings. Normans are really Vikings who invaded Northwestern France, picked up the language, and within a few generations crossed the channel to become the rulers of England in 1066. Ironically, most of the Latin words in our language came to us via Frenchified Vikings (Normans).
1066 is 400 years later ~ lots of stuff can happen.