He was above Berger and Freeh. For two years he had the launch codes on nukes. There was him and four others (one from each branch of the military) who went EVERYWHERE with Clinton to update and inform him on all military decisions. I'd consider that a top military advisor, wouldn't you?
No, I wouldn't. Clinton saw good men like Col. Patterson as schlubs. If Clinton wouldn't respect Berger, Freeh & Tenent, he wasn't going to do so with men such as Col. Patterson. Updating & informing doesn't equate to advising. In the interview Col. Patterson makes the same point as I make.