He doesn’t work for his office.
No, he doesn’t work for you either, but he does work for me and I don’t have a problem with him taking some time off and not telling me where he is.