Following your faulty logic, should people not trust Americans, the English, the Spaniards, and the French--simply because some of their ancestors drove out people from their current countries? (all human creatures are untrustworthy, but not because they invaded and displaced people).
1st, the logic of Europeans displacing indigenous peoples is very overworked. It is estimated that fewer than 500,000 people inhabited all of the current U.S. when the colonies were being established. The native peoples population both grew as a result of trade and horses and diminished as a result of war and disease.
The Turks, on the other hand, came to large towns and cities and slaughtered the people. They built pyramids of skulls to warn others not to resist. They built cruel and viscous means to torturing and killing not replicated except by Catholic Europe.
Your statement: "The Visigoths and Franks took control over the Roman peoples of Hispania and Gaul." Omits that Karl der Grosse and Alaric accomplished much by Treaty, negotiations and threat of force and only in his battles against the Saxons and muslims were large numbers killed.
So, IMO, there is no comparison.