It's "against the rules" to carry in Church in MS, but we have an armed security guard and I'd hazard he isn't the only one with a weapon.
Taking the cane from the old lady would be fine as long as you wiped any blood off it before returning it to her - whatever it takes to preserve life. You sound like you have some of the same gumption that my wife has.
I am going to start carrying an old fashioned umbrella.