The Swiss were processing the gold from Jewish teeth and other assets.
The historical fact is that the Swiss had prepared a three-part defence strategy: 1)Fight the invaders at the border forts until they fell. They were prepared to fight to the last at these forts. 2) Retreat, fighting, across the Jura Plateau, while some units broke up and harassed the stretching German lines. 3) Hold out in the "Reduit National" or "Festung Switzerland" in the high Alps, and mount forays to attack the Germans from there. To this end they had stockpiled food and ammunition enough to fight the Nazis for many years. Of course, none of these facts fit your prejudices. The Swiss have proven inconvenient to lots of foolish prejudices, including the one that an armed citizenry is a violent one. But that is another topic.
The Nazis were afraid of the Swiss? Yeah right. LOL A few bombing raids would've wiped the Swiss out in those mountains in a hurry.
The Germans knew they had someone to process their booty through, of course they weren't going to attack the Swiss.
Peace and Liberty
Peace later, not now.