Handguns not made for hunting, TW. They are designed for killing things at close range. The only thing you're likely to kill in "self defense," (which is why most people buy handguns in the first place), is a human.
The fact that you've used your handgun for self defense without firing a shot, merely demonstrates the fact that people know a handgun will kill them. And by pulling your gun, you promised to kill them if they didn't go away.
Outdoors, one can extend self defense to things like bears. But that's a secondary application.