I ate squirrel - that was enough for me. Not a fan of venison but like you said, they are pests. Many hunters who enjoy the hunt but don’t eat the meat, donate it to local food pantries. So all is good.
A young deer can be quite tasty, an old Buck is gamely, that may have been what you ate.
The only wild hog I have eaten was a huge old boar hog and it was awful. I have heard the young ones are good.