We used to have the same trouble with Superballs. never throw one in the house.
I used to be on a muzzle loading cannon team. We used a lot of balls cast with resin, but even at that reduced weight you had to be very careful.