Forum Moderators: open

Message Too Old, No Replies

Unidentifed spiders

Can anyone identify them?

         

themoff

2:03 pm on Jul 17, 2001 (gmt 0)

10+ Year Member



Hi everyone,
I've been going through my website logs and have found these UAs that I can't identify. Can anyone tell me anything about them? (I've resolved the IP that they came from and put it underneath the UA)

AOLserver-Tcl/2.3.2
homepage.lcs.mit.edu [18.30.2.64]

linecker/1.0
haymaker.leeds.wwwcache.ja.net [194.82.103.73]

webf_bgb
wfp2.almaden.ibm.com

CSE@IITBombay/1.0+libwww/5.3.2
kurma.iitb.ac.in [203.197.74.201]

Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.1+libwww/5.2.8
x1crawler2-1-0.x-echo.com [195.101.94.101]

Thanks! Robin

volatilegx

6:48 pm on Jul 19, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.1+libwww/5.2.8
x1crawler2-1-0.x-echo.com [195.101.94.101]

belongs to the viola.fr search engine.

[voila.fr...]

mivox

6:54 pm on Jul 19, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wfp2.almaden.ibm.com is from IBM's Almaden research facility... It was really obnoxious to my site, so I banned it.

Josk

7:38 am on Jul 20, 2001 (gmt 0)

10+ Year Member




Another Echo spider would be:

IP: 195.101.94.209
UA: True_Robot/1.0 libwww/5.2.8

It came in a couple of days after submitting to voila.es

Son_House

1:00 pm on Mar 27, 2002 (gmt 0)

10+ Year Member



Looks like they might have changed the ua for the ip of 195.101.94.101 We have it showing up with the ua of VoilaBot.

Also had a visit from TrueRobot with the ip 195.101.94.208

Both grabbed the robots.txt file.

Brett_Tabke

5:02 am on Mar 28, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



>linecker/1.0

That's a new one. Any info? A comemrcial program, or someone's home grown bot?

littleman

9:39 am on Mar 28, 2002 (gmt 0)



>linecker/1.0

[194.82.103.12...] (caffeine.lboro.wwwcache.ja.net)
[194.82.103.15...] (panic.wwwcache.ja.net)

[wwwcache.ja.net...]

As the use of the WWW grows and with it the demand for bandwidth, especially to the USA, many institutions, colleges and similar organisations will be establishing their own caches in the near future, and will be encouraged to link in to the UK national web cache for international access. So caching in general and the national web cache in particular, are set expand rapidly within the UK Academic Community Web infrastructure.