Except the that rescuers are climbers themselves. You've got to be an experienced mountaineer/climber to join any rescue team, and of course *willing* to put yourself at risk.
By your logic you should also be mad at the rescuers for taking the risk of rescuing.
As for the expense, rescue is available to anyone encountering trouble in the outdoors, from the most risk-taking mountaineer to the most hapless and inexperienced hiker. Should we just let them all die?
No, we should not, cannot, let them die, but their needs to be some sanity applied to the risk. I don't think that the rescuers bear the expense of this type of rescue, and it happens entirely too often.