Neutering is a quick cheap fix. Start with chemical castration. Cutting the sex drive might reduce the criminal drive as well.
Plenty of eunuchs are criminals.