Spider from multiple IP's all at once

[sammy]

I noticed a spider with UA- Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0) from multiple Ip address attaching only one page on our site.

This spider is requesting the same page every 2 to 3 seconds

Some of the ip addresses are as follows:
202.110.204.18
143.248.135.181
61.180.73.66
194.185.126.222
213.26.198.194
213.25.101.194
172.164.172.153
12.36.193.114

Any ideas how to stop this spider.

Thanks

[jdMorgan]

sammy,

Welcome to WebmasterWorld [webmasterworld.com]!

How you block bad 'bots depends upon your server. Try a WebmasterWorld site search (link at upper left of screen) for threads related to blocking and banning bad bots and user-agents.

On Apache server, you can block bad bots using mod_access or mod_rewrite in httpd.conf or in .htaccess files. In this particular case, it appears that you will have to block by IP address, since it is spoofing a Mozilla user-agent. Another approach is to filter requests using a script.

HTH,
Jim

[sammy]

I am using .htaccess file,

But how many ip address can I ban this guy is unstopable, he is using diffrenet IP address,

Here is sample of error log when I moved the file

{Thu Dec 26 12:53:41 2002] [error] [client 148.246.52.7] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:35 2002] [error] [client 152.2.69.141] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:32 2002] [error] [client 152.2.69.141] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:31 2002] [error] [client 148.246.52.7] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:29 2002] [error] [client 152.2.69.141] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:27 2002] [error] [client 152.2.69.141] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:25 2002] [error] [client 148.246.52.7] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:25 2002] [error] [client 203.148.204.81] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:24 2002] [error] [client 152.2.69.141] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:22 2002] [error] [client 152.2.69.141] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:20 2002] [error] [client 148.246.52.7] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:19 2002] [error] [client 203.148.204.81] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:14 2002] [error] [client 203.148.204.81] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:10 2002] [error] [client 200.30.128.125] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:08 2002] [error] [client 203.148.204.81] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:03 2002] [error] [client 203.148.204.81] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:53:02 2002] [error] [client 200.30.128.125] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:52:57 2002] [error] [client 203.148.204.81] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:52:44 2002] [error] [client 200.30.128.125] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:52:35 2002] [error] [client 200.30.128.125] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:52:32 2002] [error] [client 24.153.177.210] File does not exist: /xyz/xyz.html
[Thu Dec 26 12:52:30 2002] [error] [client 200.30.128.125] File does not exist: /xyz/xyz.html

Once I move the file he is attaching different file
The User Agent he is using is
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0)

Any ideas to stop this.

[GeorgeGG]

Would by any chance you have a redirect page/script?
Have had pages loop because I didn't pay close attention
to what I had the page/script redirect to :)

The logs would fill up until he/she left the page..

GeorgeGG

[carfac]

Hi:

Based on the page not existing, I would just ad a mod_rewrite to httpd.conf for "/xyz/xyz.html" which redirects to a blak hole or something... probaly all those IP's are spoofed, and you do not wnat to block by UA...

Whis is what I do to requests on my sites for formmail.cgi and other obnoxious hacker-wanna-bes...

dave