And you thought the potential problem was HIM hitting YOU???
You're lucky he didn't just walk away ...
What you told him was profoundly insulting. Think about the implication.
Not insulting. No man is going to hit me and me stay around for more. I took enough of that off my dad.