“If you are carrying a firearm any physical conflict will result in a gun fight. You can’t risk losing your weapon and being shot or have it taken from you and be responsible for someone else being shot..”
There are many lesser forms of physical conflict which would not require the use of deadly force. A typical pushing contest is one, or if a much smaller and older person slaps you.
I am sure that you can think of other examples.
Not all physical conflicts are serious or deadly.
I would never initiate any physical conflict while carrying.
I will back away like a coward if it means not having to shoot at someone, as long as I and any innocents threatened are safe in doing so.