Col Lee was not the officer in charge of the armory. He was the officer assigned a unit of Marines to take it back, put down the rebellion and arrest John Brown.
Thanks for the clarification. I should have been more specific.