So, I did further research. (Diana will laugh.)
It turns out all sorts of things will drive wood bees off, and maybe the easiest for me is loud bass sounds (vibrations). I'll have to hunt for them, but, somewhere I have a couple of these:
https://www.parts-express.com/Dayton-Audio-BST-1-High-Power-Pro-Tactile-Bass-Shaker-50-Watts-295-244?quantity=1
The beauty here is that I can "apply" one of these to the top of the wellhouse roof and hold it in place with a little rope and a couple bungee cords, also keeping a cheap blue tarp over the shaker to ward off rain.
If that doesn't work, I really CAN pipe in car exhaust from outside, without risking getting stung. And having pondered it a bit more, Dad had some insecticidal smoke bombs "somewhere", too...
More traditional solutions (not all apply in my case):
https://www.homedepot.com/c/ab/how-to-get-rid-of-carpenter-bees/9ba683603be9fa5395fab90feb70005
Do it on colder weather or the coolest time of day as well.
Cold stuns stinging insects.