There’s verbiage in the contract. Conduct detrimental/unbecoming to the league. But since the Pats hired the guy in the first place, how likely are they to exercise that?
Note to the NFL: If you’d stop hiring degenerates, that would solve a lot of your problems.