Would you have walked out if the pastor's politics agreed with yours?
(That said, I don't know if I would have walked out but I certainly would have been pissed.)
Obviously not, but the alarms would still be going off in my head. I know a lot of people will disagree with this but I equate Pat Robertson with Jesse Jackson, both being more politician than "religious leader."
In theory, I don't think a priest should talk politics either way.
However, If he/she agreed with me, I'd be inclined to cut some slack. (grin)