Technically the Koran only condones violence of any type when in the face of the crusaders or infidels....
From there, it is all about how you read it....
The Quran was written and redacted prior to the Crusades.
The Quran does, as you correctly point out, affirm violence against non-Muslims.
The Quran does not simply sanction defensive violence - but punitive violence and violence meant to coerce and convert.