Free Republic
Browse · Search
News/Activism
Topics · Post Article

To: Jim Robinson
AT the risk of wasting your valuable time, the following is exactly what I get when I click on either your link or that above:

User-agent: googlebot # allow Google crawler
Disallow: /search

User-agent: gulliver # allow Northern Light crawler
Disallow: /search

User-agent: slurp # allow Inktomi crawler
Disallow: /search

User-agent: fast # allow FAST crawler
Disallow: /search

User-agent: scooter # allow AltaVista crawler
Disallow: /search

User-agent: vscooter # allow AltaVista image crawler
Disallow: /search

User-agent: ia_archiver # allow Internet Archive crawler
Disallow: /search

User-agent: * # disallow all other crawlers access
Disallow: /

I must have done something very, very bad, huh?

16 posted on 11/16/2002 6:38:35 AM PST by .30Carbine
[ Post Reply | Private Reply | To 15 | View Replies ]


To: .30Carbine
Strange. Ok, try going to Alexa's main page: http://www.alexa.com then enter "freerepublic.com" into the search box. Then click on "Traffic Detail" in the left hand menu. Scroll down a bit and you should see a chart of our activity. Just beneath the chart is a box where you can enter domain names of other sites to compare to Free Republic.
17 posted on 11/16/2002 11:53:39 AM PST by Jim Robinson
[ Post Reply | Private Reply | To 16 | View Replies ]

Free Republic
Browse · Search
News/Activism
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson