You're changing the way baseball has always been played and giving a big advantage to hitters.
Players being seriously injured by a pitch are extremely rare. There is a better chance of serious injury being hit by a line drive since the fielders aren't wearing helmets.