Welcome to WebmasterWorld Guest from 54.162.227.136

Forum Moderators: DixonJones & mademetop

Message Too Old, No Replies

Strange user in log file

Do libraries spider?

     
3:37 am on Jun 27, 2001 (gmt 0)

10+ Year Member



I have 71 hits within 1 minute 27 seconds from: 202.108.223.8 - - [24/Jun/2001:15:26:29 -0700] "GET /****.html HTTP/1.0" 200 6220 "-" "Mozill

(edited by: mdharrold at 3:40 am (gmt) on June 27, 2001

Woz

4:40 am on Jun 27, 2001 (gmt 0)

WebmasterWorld Senior Member woz is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Hi MD,

202.108.223.8 resolves to the IP block used by capitalnet.com.cn, a Chinese ISP tagetted at business. It could be a dialup account, or a small company, or... As to why they are spidering you, depends on your site.

Hope this hbelps

Onya
Woz

8:50 pm on Jun 27, 2001 (gmt 0)

10+ Year Member



My copy and paste did not show up entirely above 202.108.223.8 - - [24/Jun/2001:15:25:11 -0700] "GET /*.html HTTP/1.0" 200 8884 "-" "Mozilla/3.0 (compatible; Indy Library)"

Thanks for the IP info Woz.
If that is a dial up IP, can you run a spider on a dial up?

11:31 pm on Jun 27, 2001 (gmt 0)

10+ Year Member



In theory, yes. A robot is just a program running on a computer that can crawl webpages through http requests. It can run on a dial up from the computer it is on but that is not something any serious buisness would do :)
6:10 am on Jul 1, 2001 (gmt 0)

10+ Year Member



Hi mdharrold

I also have been hit by Indy Library (but not recently) and find it a pain. You can find some more info on it in this thread:

[webmasterworld.com...]

6:39 am on Jul 1, 2001 (gmt 0)

WebmasterWorld Senior Member littleman is a WebmasterWorld Top Contributor of All Time 10+ Year Member



After feeding them blank pages for about a month they decided to leave me alone.
9:56 am on Jul 1, 2001 (gmt 0)

10+ Year Member



lol :)
1:57 pm on Jul 11, 2001 (gmt 0)

10+ Year Member



:-)
 

Featured Threads

Hot Threads This Week

Hot Threads This Month