Welcome to WebmasterWorld Guest from 54.196.244.45

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Strange user in log file

Do libraries spider?

     
3:37 am on Jun 27, 2001 (gmt 0)

Full Member

10+ Year Member

joined:Mar 19, 2001
posts:220
votes: 0


I have 71 hits within 1 minute 27 seconds from: 202.108.223.8 - - [24/Jun/2001:15:26:29 -0700] "GET /****.html HTTP/1.0" 200 6220 "-" "Mozill

(edited by: mdharrold at 3:40 am (gmt) on June 27, 2001

Woz

4:40 am on June 27, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member woz is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Aug 13, 2000
posts:4823
votes: 0


Hi MD,

202.108.223.8 resolves to the IP block used by capitalnet.com.cn, a Chinese ISP tagetted at business. It could be a dialup account, or a small company, or... As to why they are spidering you, depends on your site.

Hope this hbelps

Onya
Woz

8:50 pm on June 27, 2001 (gmt 0)

Full Member

10+ Year Member

joined:Mar 19, 2001
posts:220
votes: 0


My copy and paste did not show up entirely above 202.108.223.8 - - [24/Jun/2001:15:25:11 -0700] "GET /*.html HTTP/1.0" 200 8884 "-" "Mozilla/3.0 (compatible; Indy Library)"

Thanks for the IP info Woz.
If that is a dial up IP, can you run a spider on a dial up?

11:31 pm on June 27, 2001 (gmt 0)

Full Member

10+ Year Member

joined:Sept 29, 2000
posts:297
votes: 0


In theory, yes. A robot is just a program running on a computer that can crawl webpages through http requests. It can run on a dial up from the computer it is on but that is not something any serious buisness would do :)
6:10 am on July 1, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 1, 2001
posts:183
votes: 0


Hi mdharrold

I also have been hit by Indy Library (but not recently) and find it a pain. You can find some more info on it in this thread:

[webmasterworld.com...]

6:39 am on July 1, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 17, 2000
posts:2924
votes: 0


After feeding them blank pages for about a month they decided to leave me alone.
9:56 am on July 1, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 1, 2001
posts:183
votes: 0


lol :)
1:57 pm on July 11, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:May 16, 2001
posts:48
votes: 0


:-)