Been there, done that. No hassle, but I'd prefer that we could exercise our right bear arms without such permit. Although my ugly black rifle is a larger caliber than the average US grunt carries.
Perhaps you live in the wrong state?
Sorry, but there is no state in which a citizen can go out and buy a newly made M4 rifle like many troops carry. None.