Depends on the man and it depends on how seared or unseared his conscience is. The guys in my church would not have spoken up if they had no problem with what was being exposed. The pastor took in their requests, prayed, and felt the need to speak.
How is he going to answer to the Lord when his life and responsibilities are reviewed if he ignores these men's requests?