Organize them into local militia with a rudimentary chain of command and have shooting ranges an drills every other weekend too
Exactly! No one would want to deal with a massive and well prepared guerilla army on their home turf.