Come to think of it, in the earlier books I thought it mentioned that he works there, but in OoTP everyone was upset because he was seen there. Hmmm.
OK, that's it! I am starting over at Socerer's Stone...there are just too many things going on in the background that just jump out later.
Speculating on all these bits should keep me busy until GoF is released. :)