Buy one of the thick sheepskin pads that you can put on the shoulder harness. They have them at auto stores and even WalMart. I had the same problem, and the pad not only makes the belt more comfortable and keeps it off your neck, but covers up that sharp edge.
Maybe that will work. Thanks for the tip. :)