As long as the government has a role in those areas, for good or for bad, then it’s reasonable for the government to take into account an individual’s sexuality. After all, sexuality matters. It’s not like race where it doesn’t matter.
You are disagreeing with libertarianism.