Your statement seems to imply that you have equated celibacy with disinterest with marriage - although this is a common misconception, it is patently false.
The vocation of marriage is a good. However, the celibate willingly forgoes this good because God has called him or her to live without a spouse for the betterment of His Kingdom - see I Cor. 7 for St. Paul's explanation of this. Celibacy (properly understood) is also a good - and is the greater good for those God has chosen for it.
Those who are homosexuals, pedophiles, and ephebophiles have historically used celibacy as a means of concealing their own temptations and sinful acts, because the celibate lifestyle allowed them to either hide their inclinations or (in the unfortunate cases we hear about now) act upon them and still remain above suspicion.
If a person is discerning a celibate life and seems to have no attraction whatsoever to marriage, it is viewed as a 'red flag' that something is amiss, and would be something that would lead to not being ordained (in the case of a seminarian) or not being admitted to final vows (in the case of a religious). The embrace of celibacy is not simply a rejection of married life - rather it is the free acceptance of celibate chastity for the sake of building up God's kingdom. Those who have sought a celibate lifestyle as a manner of hiding should never have been admitted and ordained/professed - because they couldn't choose celibacy in freedom due to the chains of their perversions.
There are plenty of homosexuals, pedophiles, and other perverts whose "interest in marriage" has not quenched their perversions. Thus while disinterest in (heterosexual) marriage ties to the other perversions, there is nothing inherent in celibacy that ties to any of the perversions.
I do not believe that celibacy necessarily indicates a lack of interest in marriage/women — but I believe it can be a good hide-out for those who are disinterested and don’t want to answer a bunch of questions about their lack of interest.
SnakeDoc