I'm talking about considerably more than the pastor's sartorial tastes. I've also known enough Protestants, and enough Protestant pastors, to know how painstakingly pastors are judged by their congregations on every aspect of their preaching.
A Pastor should be judged on the content of his message. If he is being judged by the congregation on another basis, that, in my mind, is a failing of the congregation (and, ironically, the Pastor, for allowing his congregation to fall into that trap) and--more importantly--unChristian.