Imagine taking a shower but instead of water droplets billions of sub-atomic particles blasting you..
Would you prefer neutrons or gamma rays?
Over time the solar wind will wear away the shield side and it will fail.