I have always heard that to be the belief. Not always, but many times, the gay man will hold the straight woman in contempt mixed up with envy.
Not to mention the painful reminder of what he at some level knows he should be: straight.
If there's any real "misogyny" in the world, this is where it's found.