Nah, most don't start out being perjoratives. But the people who take on those labels make them into perjoratives.
If you put the label "Roses" on a can of crap long enough, the word "Roses" becomes a synonym for "can of crap".