The courts certainly do not have to get constantly involved unless the university has a do-do brain for legal counsel. Or a wish to ignore very expensive advice from that counsel. Which would not surprise me.
It would be ill advised for the university not to have very clear rules and guidelines for allowing outsiders to access the campus and speak. Including definitions for “disturbance” and what would violate any noise restrictions.