They know his crimes. They can always have him arrested for acts of corruption.
That’s why Joe is going to hang on. He doesn’t want him or anyone of his family to end up in jail.