New Altavista Behaviour...

libwww-perl/5.46 for av?

[skirril]

Hello, some altavista came by, and crawled my whole site, well-behaved, about 1 hit per second.

The only thing that struck me is the user-agent, libwww-perl. I would have thought AV would use something more ingeniuos that the perl-www library.
--
www.altavista.com - - [30/May/2001:22:20:54 +0200] "GET / HTTP/1.0" 200 6168 "-" "libwww-perl/5.46"

[skirril]

oh, something else: did NOT get the robots.txt file.

[Brett_Tabke]

What was the ip address?

[WebGuerrilla]

Sounds like someone spoofing an AV useragent.

[skirril]

The line below the dashes is my actual logfile entry, its all I have (plus a few others with different GET requests)

June 1 to 3, I saw a few scooters coming by,
scooter3-scooter6.sv.av.com

they exhibited "normal" scooter-behaviour (ie. respected robots.txt, did not put more than one hit per second on my site, etc..)

Was just puzzled that av would use an (unadapted?) libwww-perl