Forum Moderators: open

Message Too Old, No Replies

Inktomi and Freshbot doing lots of crawling

simultaneously

         

Clark

7:32 am on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Between the two of them, who needs users anymore? :) I got plenty of traffic just from bots! Let's kick off the humans! :)

Now if only google and inktomi were to keep web-visible logs of their own crawls the two of them would crawl each others logs in an infinite loop.

lawman

11:08 am on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



:)

lawman

Marcia

12:34 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>web-visible logs

You mean like eXtreme Tracking?

Clark

7:58 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Good point Marcia! That's an infinite loop right there!