It's not a question of "another second", it's a question of being able to get your pistol out and on target while some dirtbag is choking you, or you are fending off a knife or bat with your weak arm.
IOW, if you cannot defend yourself one handed, you may not be able to defend yourself at all.
Further, if you leave a pistol loose in a pocket to get entangled with keys etc, you should seriously rethink your procedures.
My plan is to kneel with one knee in the gut of the malefactor while checking the action of the firearm for dustballs. If knowingly going into a firefight, the pistol won't be in the pocket to begin with but strapped on, and then it wouldn't be a pistol in my hands anyway but something a little more results oriented.