I think I would have phrased it “...WITH me”.
Why? He’s probably referring to a pocket pistol which is quick and easy to use.