The plot you describe was a dirty harry movie Magnum Force. In the star chamber a select few, judges etc decided which criminals who were getting away needed to be killed and contracted for their killing.
You're right, I was getting those two movies mixed up. I liked them both!