In winter, nobody finds it unusual to see a man walking around with his hands in his pockets. And the fastest draw is to already have it in your hand. A leather coat also has the advantage of protecting you from knife cuts, to an extent.
I like front chest ‘slash pockets’ on parkas for that in winter.