Its not homophobia ,no one is scared of them, its using the gay lifestyle as slur. Which depending on your upbringing may be offensive to you.
You’re right. “Phobia” gets wrongly attached to too many words.