It doesn’t matter where it occurred. It’s the way you handled it which is the issue. It’s not as if he grabbed your butt or told you you had great boobs.
I would bet large and give long odds that he never gave what he said a second thought because like those waitresses in NJ it is not meant to be disrespectful.
Isn’t it all about “intent”?
Frankly you sound like the sort who would run to HR if you walked by the water cooler and overhead a guy telling another guy a dirty joke which included women.
I actually like being flirted with when we are not working and think dirty jokes are hilarious. But I don’t like to be called hon in a business setting and I will stick up for myself. I worked hard for my law degree and served as a JAG officer and like men who are manly. But if they are trying to cut me down to size, I am not having it. I am a blond
100 pound female and I don’t have to take their bullshit. Or yours.