"While their criminal behavior was not justified," Again, be careful, their behaviour may very well have not been criminal.
Correct, let me rephrase that: "While any alleged criminal behavior would not be justified..."