JKMitchell
msg:3037682 | 7:21 pm on Aug 7, 2006 (gmt 0) |
It's also hammering all the sites hosted on my servers with no regard to robots.txt or bandwidth (clocked at 18 pages per second)! <edited>
In my case the culprit seems to be s15205108.onlinehome-server.info (also in Germany?) I wonder if this is like the Grub project that was running a couple of years ago
</edited> [edited by: JKMitchell at 7:24 pm (utc) on Aug. 7, 2006]
|
GaryK
msg:3037710 | 7:34 pm on Aug 7, 2006 (gmt 0) |
Same thing here. Right now it's banned by user agent. Hopefully that'll be enough.
|
marktheleg
msg:3038401 | 11:14 am on Aug 8, 2006 (gmt 0) |
I've been having troubles with this one too. Totally ignores the robots.txt on all of my sites (i've disallowed it in there too). The way i've stopped it for now is to call a bit of asp in the pages i want to keep it out of that requests the "user-agent" server variable and if it matches the "192.comAgent" redirects it to a custom 401 page, which in turn requests the ip (remote_addr server variable) and redirects it back to itself :) Until who ever is responsible for this bot sorts it out i'm keeping it out.
|
JKMitchell
msg:3044147 | 8:40 pm on Aug 12, 2006 (gmt 0) |
| The way i've stopped it for now is to call a bit of asp in the pages i want to keep it out of that requests the "user-agent" server variable and if it matches the "192.comagent" redirects it to a custom 401 page, which in turn requests the ip (remote_addr server variable) and redirects it back to itself :) |
|
Thats a neat idea and might give the bot the idea that it's not wanted.
|
|
