Cheney excepted?
Sure, Cheney was great. But, one time someone went over Niagra Falls in a wooden barrel and lived to talk about it. Does that mean going over Niagra Falls in a wooden barrel is a good idea? Probably not.
Just because we've had some successful Secretaries of Defense that we're not prior service, doesn't mean it's a good idea.