Not when applied to oneself, as in that instance. I have more than enough insight into my own personality to recognize my own considerable homophobic impulses for what they are.
Two observations... I inferred that in explaining your own avoidance of "homophobia" that you thought that another hadn't, in which case it wouldn't only apply to yourself. Perhaps I was mistaken.
Second, "homophobia" is a slur because it's not a legitimate term, it was invented as a pejorative, and remains so regardless of the target.