I have had a ccw permit for over 30 years and I still have not used it!!
Imagine that!
Well then, you obviously don't need it.
Please turn it in. If you ever do really need it, you can re-apply, wait ninety days, ... then maybe you can deal with the threat.