It is my humble opinion that Rudy can have nothing to do with domestic law enforcement. I like my guns too much. SecDef, SecState, or CIA.
But with a President Fred Thompson (my #1 hope) or most of the others it would be the President's position on the second amendment, not Rudy's, that mattered, even with Rudy as AG. I don't like him for Defense and think he'd be a disaster at State. He's a New Yorker, and a "street kid" type New Yorker at that, which would be an asset at AG or CIA, but a big drawback as Secretary of State.
You might be right about him for CIA as that place needs a very strong hand that will muck out the stables.