It's only perceived that way by those who feel insecure in their unearned elevated status. For most people "envy" is merely another facet of the natural human motivation to improve one's own condition in life. Disdainful pride, gluttony, avarice and sloth are actually much more unbecoming.
Nice of you to admit it. It's the first step toward recovery!