He could have asked what he was doing from a distance. Look, if you come into close contact space (ie - your reach), after getting out of your care, with what could very well be interpreted as bad intentions, I'm not going to respond politely. I have no idea who you are. You could be a robber.
I'm going to first try and get out of dodge, like Martin probably did. If I can't get out of dodge, I'm going to use appropriate force to stop the threat beyond all certainty.