Free Republic
Browse · Search
News/Activism
Topics · Post Article

To: jurroppi1; Danae

BTTT.

Danae, I believe the term Robots is a misnomer, there is a robots.txt file, or a simple code snippet used to tell a web crawler (google cache, archive.org, etc...) to not crawl a given url or domain. I can look into the proper term(s) further if you like.


38 posted on 10/20/2011 2:03:41 PM PDT by jurroppi1
[ Post Reply | Private Reply | To 16 | View Replies ]


To: jurroppi1

That is pretty much exactly what Leo found. As far as I know, it is an accurate description. If Justia goes to remove itself off of InternetArchive.org, that would be an admission of guilt. And believe me, we are watching the archive to see if Justia puts up mor of them on the pages we have published today, and the ones Donofrio has published at his site: http://naturalborncitizen.wordpress.com/2011/10/20/justia-com-surgically-removed-minor-v-happersett-from-25-supreme-court-opinions-in-run-up-to-08-election/


39 posted on 10/20/2011 2:06:44 PM PDT by Danae (Anailnathrach ortha bhais beatha do cheal deanaimha)
[ Post Reply | Private Reply | To 38 | View Replies ]

Free Republic
Browse · Search
News/Activism
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson