It doesn't. But I worked for a public university. No one cared what I did "off-campus", but my office was considered a public space. For instance, I really would have thought it inappropriate to hang a crucifix there.
But, as I said, the issue never came up. And there were many devout Jewish students there.
Your office or your room?