Replies

To: mojitojoe

Page cannot be crawled or displayed due to robots.txt.

What does that mean? Robots?

224 posted on 02/13/2012 8:32:07 AM PST by getmeouttaPalmBeachCounty_FL (..................go Giants!!!.....heh-heh (Champs!!))

[ Post Reply | Private Reply | To 223 | View Replies ]

To: getmeouttaPalmBeachCounty_FL

Web Robots (also known as Web Wanderers, Crawlers, or Spiders), are programs that traverse the Web automatically. Search engines such as Google use them.

http://www.robotstxt.org/robotstxt.html

227 posted on 02/13/2012 8:46:47 AM PST by mojitojoe (SCOTUS.... think about that when you decide to sit home and pout because your candidate didn't win)

[ Post Reply | Private Reply | To 224 | View Replies ]

Free Republic
Browse · Search

News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794