The founders understood that the wrongdoer should suffer the consequences -- not society. Police officers who made a false arrest or who wrongfully searched a house without a warrant were liable. They were often sued and had to pay damages. This was an effective deterrent to the violation of citizen's rights.
Letting the criminal go does not punish the wrongdoer. It punishes society. The cop that did it just goes and gets another doughnut.
In the absence of a free and fair judicial process at all levels, you don't know that any particular person is a criminal, and hence cannot treat them as such. You cannot legitimately separate society from its agents in such a case.