In my estimation, that depends on whether the initial loyalty is to the man or the principle.
Myself, I stick with someone of character whom I didn't agree with on all issues, rather than going with someone who mouths platitudes I agree with but has no character.
It is a difficult choice for many. I am comfortable with my decision.