I once did the same thing on a United charter flight carrying Forest Service fire crews from Oregon to southern California. When I realized I was wearing it, I quietly took it off my belt and put it in a pocket, no problem.