Never let the bad guys leave, they can just regroup.
Just like Garthe [whatever] and his termites in TWD.