Forum Moderators: coopster

Message Too Old, No Replies

Prevent Rogue Spiders / Rippers

Script options

         

ukgimp

9:40 am on Jun 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ok, I am getting the needle with some people out there. Constant bloody ripping sites.

Is there anyway to do it on the fly with a function of some sort. I have the haccess ban list in usage which I am sure helps, but it would be nice if there was a way to check how many requests had been made by a spider and how long it had been since the last request. So if a one request was sent every second from one IP, you could ban them on the fly and be notified about it for a quick check.

Pehaps there is a way to turn the ban list on is head in htaccess and only allow certain UA's therefor the majors get a pass and so do most browsers unless they get out of hand and the autobanning kicks ins.

Does anything from the above sound like reality.

Cheers

Timotheos

3:41 pm on Jun 15, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



This is it...
[webmasterworld.com...]