Well... As for swords and axes... I definitely recommend getting a couple of each and learning how to use them. They’re great in close quarters and never need to be reloaded. :-)
If you’re going to go the axe and sword route, might as well go all in with a vuvuzela as well:
https://www.youtube.com/watch?v=R8JGhoVybkM
Tomahawks, battle axes and a flange head mace. Yup got it covered. Next on my list: a good sturdy spear. You gotta keep those zombies farther away than arms length....