The Holocaust Museum in Washington has a display that shows the various insignia that were required to be worn by different groups in the concentration camps. There was a special one for homosexuals. As you can see in this chart, they were required to wear a pink triangle. Evidently enough of them were rounded up to make this separate category necessary.
The Nazis had no interest in anyone's sexual orientation. Indeed, they ignored the homosexual subculture of the SA for the entirety of the Reich.