You are right that it is abused, and that ends up hurting both men and women—since men start to be afraid of dealing with women in the workplace.
I think it should be pretty clear that there should be lines that should not be crossed—but also darned good evidence that such lines have been crossed. And in a lot of cases, even attempted misbehavior on the part of men can be stopped and/or ignored on the part of women. We don’t need a lawsuit every time that somebody is a jerk. But if an employer condones and thus perpetuates such behavior, a lawsuit is entirely in order.
More times than not, no lawsuit is involved but it is the threat of a lawsuit or a firing that shuts up most men very fast.
You see, this is all about power, not sex. Women want the power to discard any man at the office they believe is a big enough jerk and you can take plenty of out-of-context comments and make them *appear* to be harassment. How does a man tell an African-American secretary that he wants his coffee black without it sounding like possible harassment? At one of my favorite restaurants, I subjected a waitress to some giggles when I asked innocently enough if she wanted to eat the pickle that came with the sandwich. She was flattered that I invited her to eat my pickle.