Let's say we're going to nuke 'em, then let them seal themselves in the caves.
When they pop their heads out, fly a squadron of B-52s overhead and let them duck into the tunnels again.
Keep 'em there for about 50 years.
Gives new meaning to "Whack a Mole"...