> One of them pointed at me and said, This guy just pushed me’ to her peers. <
That is a rather common technique. Another variation is “What did you just say? Did you just insult/disrespect me?” (Of course, you actually had said nothing.)
In either case, it’s a heads-up moment. And probably it’s also time to retreat - because you will be outnumbered.
Is retreating cowardly? No. It’s common sense. A karate master once told me that the best defensive move of all is “not to be there”.
No personal experience, thank God, but I have noticed the use of the instant lie by the lowlifes, both black and white. And in a group, they back each other up. As you say, it’s time to retreat, if retreat is possible.