Indeed. It can not be healthy for a gay person who is committed to celibacy to be put in the path of temptation. Which I think would be the case in an all male environment. Intentions and desire to follow Church teaching on sexual morality is a good thing and should be supported. You don’t put an alcholic to work in the liquor store. Same here.
Additionally, any man that has effeminate mannerisms is obligated to make an effort to cover them up, to change them, for effeminate men are a bad example to children, a scandal.