I was lucky enough to find the book that complemented the TV show, has some wonderful photos. He didn’t stay holed up in the dead of winter, he went out, took photos etc knowing full well if he fell he’d die of exposure. I believe he only wintered over once but went up there every spring/summer for a long time as you say.
I read that book...my understanding was that he spent ALL year there...until he became to old.