It's not a big deal until some anti-2nd amendment idiot goes hysterical, calls the cops and tells them you are threatening everyone in the establishment because you have a holstered gun on your belt.
See "Erik B. Scott, Costco Las Vegas."
We can't protect ourselves from ever possible contingencies...I for one think I have a much better chance of dieing from being unarmed than from being armed.