Who are we to judge?
In regards to elders (priests, etc), the scripture says, "Those who are sinning rebuke in the presence of all, that the rest also may fear."
In regards to sexual immorality, the scripture says that anyone who rejects the commandment against sexual immorality has rejected God. 1 Thess 4:1-8.