Exactly! That is the thing that is very offensive. Responsible adult heterosexuals have a lot else going on in their world besides the fact that they have sex. But the politics of homosexuality acts as though the sexual dimension of their society is the only thing that matters.
As a 50-year-old, white, heterosexual father, and recently unemployed, I couldn't have made the point any simpler, except to say, "Why should I care?"