To me, that word demands neither interfering with non-participants, nor with others exercising the same right with an opposing voice.
Violence has many shapes and degrees. Intimidation is not a right.
Again, they’re likely violating a variety of NYC ordinances/laws, and it would be nice to see NYC enforce them - as they would very likely do were a Tea Party in violation of something... anything.