There are existing caverns that would serve just fine, blocking the gamma rays.
Hmm.
I always imagined domes on the lunar surface, open to the starlight, where people could live and always look up to view the celestial scenery. In a cavern, they would be stuck looking at rock. Maybe shielded windows could give them a view.