NorthernLight's Gulliver/1.3 on the move!

Forum Moderators: bakedjake

Message Too Old, No Replies

NorthernLight's Gulliver/1.3 on the move!

Crawling Everything it can find -- Anything new I don't know about

fathom

5:24 am on Jul 20, 2002 (gmt 0)

64.95.79.195 - - [19/Jul/2002:17:30:46 -0400] "GET /robots.txt HTTP/1.1" 200 174 "-" "Gulliver/1.3"

Been deep crawling ever since.

I thought NL was a private archive now.

Something change, maybe a Yahoo thing?

66.237.60.45 - - [19/Jul/2002:17:28:55 -0400] "GET /robots.txt HTTP/1.0" 200 174 "-" "Openfind data gatherer, Openbot/3.0+(robot-response@openfind.com.tw;+http://www.openfind.com.tw/robot.html)"

Openbot same thing and almost the same time.

mbauser2

11:44 am on Jul 20, 2002 (gmt 0)

I thought NL was a private archive now.

Yes, but it still includes an archive of the public web. At my domain, Gulliver never quite went completely away, but I think you're right, he has gotten a lot more active lately. (For bot activity in the last thirty days at my site, Gulliver is ahead of Openfind and behind ia_archiver.)