With a few exceptions, I'd say that's a fairly accurate assessment.
Both extremes of the political spectrum tend to be filled with the angry, the bitter, and the humorless.
If Rudy Giuliani's cross-dressing escapades were the worst thing he ever did in public, you might have a point. His own well-documented radical leftist track record on a few key issues disqualify him from any consideration as a presidential candidate, in my opinion.
My biggest concern about these cross-dressing episodes is that they -- in combination with other aspects of his personal life -- paint a picture of a person with some pretty serious psychological baggage.