No, it makes perfect sense. If I can't have sex with my wife, I go have anal sex with a man or molest a child. Brilliant deducing!! Now I know what I can do next time my wife has a headache. (/sarcasm).
Men who ejoy sex with women are not likely to join the priesthood since they cannot even marry. Consequently, the priesthood attracts some men who recognize its potential for gratifying unnatural desires--like gay men who join the military or become scoutmasters, or pedophiles who seek work at daycare centers.
If St. Peter himself was married along with a number of other disciples, I fail to see the theological basis for not allowing priests to marry.