It is sad when a male who appears to have a handgun is seen as a public danger. I am a male who has a handgun and I will protect those around me.
It would certainly raise my eyebrows and make me question why someone not in uniform is walking around with a handgun in plain sight.
Plainclothes security guards, off duty peace officers, business owners, whoever, may be carrying, but if the gun becomes visible, common sense dictates to me to be on the alert and quickly scan for exits.