Not only has Damon been banned from the court room; he has been banned from the entire third floor location for the duration of the trial