Yes! It was 1984, middle of the winter, and my only means of transportation was a Honda motorcycle. I rode several miles to the closest Catholic church, just to be stopped at the door by a priest who did not consider my clothing "modest". Guess what? It would have been much more immodest if I had worn a dress, and the helmet on my left hand made it very clear how I had got there. Needless to say that was the last time I set foot in that church!
Enforcing rules of dress within a church is different from attacking people walking down the street. However if you were dressed modestly, the priest was mistaken. It is also mistaken to give up on the Catholic faith in the face of trials.