Solid copper bullets work well for hunting, but obviously going to be more expensive. Tungsten and bismuth are used as substitutes for lead in fishing weighs.
Hmmmm a tungsten core with a tungsten-bismuth sheath would be a penetrator. Add some magnesium to the core . . .