Right, maybe even Secretary of State. In that position he could use his 'toughness' to great effect.
The problem is that the State Department is so full of leftists that Rudy might become fickle on his only "strong" area (look at Powell, he was a moderate when he became Secretary and four years turned him into a liberal).