yeah, perfume makes my head hurt too, but most of the heavy perfume wearers seem to have given it up around here. Or you have to get really close to them to smell it. I think that is the difference, you don't smell perfume 20 feet across the room.
Maybe YOU don't.