No. You initiated the confrontation and your actions could easily be construed as threatening. If the manager didn't or wouldn't get them to quiet down, you leave - they were no threat to you.
You're a dangerous guy, judging from this story, and really should rethink your decision to carry a weapon. Or the odds of you ending up in prison for negligent homicide will eventually catch up with you.
I work late, handle cash in public and have a business, employees and myself to care for. I also have a CCW and guess what - I think you acted like an ass.