Concrete and packed soil also work, and are cheaper than lead. It depends on how much gamma is emitted. If it’s a few photons per hour, no big deal.
Or you could build it inside a "big" tank of water. Water from the tank serves as house hot water system. Think of LLOOONNNNNGGG showers!!!