Are you saying that if Joseph wanted to have sex with Mary that was a disordered desire? I DO NOT believe that!
Joseph perceived that Mary was a holy vessel, consecrated unto God. And so he did not allow himself to desire sexual relations with her. He was of such a virtuous constitution that this was not a cause of stumbling for him. It is also for this reason, as I explained above, that Mary did no injustice to Joseph by not engaging in sexual relations with him.
-A8