Actually, if a judge, courtroom or legal jurisdiction had somehow over time allowed access and/or permission, the same 5A rules would apply to them as well. Everyone should become with the concept of adverse possession, and how over time rights, privileges and even ownership can accrue. It's actually one of the core foundation aspects of law governing private property.
However, lawyers are generally pretty smart, so they would never allow such a situation to be created in the first place. Trump's mistake was honoring prior protocol, instead of revoking all passes and creating a new system that stipulated terms and conditions. But guess what's coming next? Exactly that kind of tightened up permit process.
That sounds like legal gobbledygook. The Constitution was written simply; lawyers and their gobbledygook have corrupted it.
Let me put it this way: If someone had approached George Washington in that manner, that someone would have spitting out his teeth, and NO ONE would have complained or argued that George Washington didn’t have a right to do it.
Lawyers have corrupted, convoluted and even prissified our country and its Constitution, creating law where there is none, and corrupting laws that are constitutionally based.