Forum Moderators: DixonJones

Message Too Old, No Replies

[\"iVia Site Checker\"/1.0]

...is really from Infomine

         

pendanticist

12:28 am on Sep 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



When I saw this:

138.23.89.56 - - [18/Sep/2003:08:22:48 -0700] "GET /robots.txt HTTP/1.0" 200 1493 "-" "Infomine Virtual Library Crawler/3.0 (see http*//infomine.ucr.edu/projects/vl_crawler/
138.23.89.56 - - [18/Sep/2003:08:43:39 -0700] "GET / HTTP/1.0" 200 20690 "-" "Infomine Virtual Library Crawler/3.0 (see http*//infomine.ucr.edu/projects/vl_crawler/)/1.0"
...I was naturally glad to see them come-a-calling.

Then, the same IP Number came back a bit later calling itself by a different UA.

138.23.89.56 - - [18/Sep/2003:11:34:06 -0700] "GET /Blahblah.html HTTP/1.0" 200 2884 "-" "\"iVia Site Checker\"/1.0"
138.23.89.56 - - [18/Sep/2003:11:34:07 -0700] "GET /Blahblah.html HTTP/1.0" 200 15996 "-" "\"iVia Site Checker\"/1.0"
138.23.89.56 - - [18/Sep/2003:11:34:07 -0700] "GET /Blahblah.html HTTP/1.0" 200 1879 "-" "\"iVia Site Checker\"/1.0"
I should point out the "/" and "\" are as found.

Pendanticist.

jeremy goodrich

9:15 pm on Sep 19, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Strange bot behavior, - thanks for the heads up.