idiotgirl
msg:3687089 | 6:56 pm on Jun 30, 2008 (gmt 0) |
I did a search on this one last night, as well. Came across an interesting article (Google "WebDataCentreBot") that connected the dots between WebDataCentreBot and Midphase:
"Midphase.*** is the generic PTR record of a Softlayer reseller... Therefore, firewalling this particular range seems an appropriate solution to me..." It did the same thing to me, got trapped, and drew attention to itself. Once I saw the cheesy temporary site for it, and its reluctance to share any meaningful information about its purpose, I banned it. No soup for them.
|
wilderness
msg:3687104 | 7:11 pm on Jun 30, 2008 (gmt 0) |
I've had the Class B denied for some time.
|
Receptional Andy
msg:3691605 | 2:56 pm on Jul 6, 2008 (gmt 0) |
Came back today on 66.150.224.x
|
idiotgirl
msg:3691703 | 6:48 pm on Jul 6, 2008 (gmt 0) |
As far as I can see there is no stopping this bot. It doesn't respect robots.txt and comes slinking through like a hungry dog every time you turn around. It will gladly eat 403's for eternity until you firewall them out.
|
incrediBILL
msg:3691722 | 8:15 pm on Jul 6, 2008 (gmt 0) |
Since I whitelist Google, Yahoo, MSN, they go through first and then anything with "http://" in the UA is blocked so stuff like that is easily stopped. Of course it has also blocked a couple of browser plug-ins in the past which in one case caused a small riot and got the "http://" removed from the UA of that plug-in ;)
|
thetrasher
msg:3695418 | 2:18 pm on Jul 10, 2008 (gmt 0) |
Today from 82.96.19.**
No robots.txt
|
idiotgirl
msg:3695705 | 8:04 pm on Jul 10, 2008 (gmt 0) |
Appears to have added a new IP from Sweden (82.96.19.*). Its cheesy intro page says "driven by a small team of researchers from different parts of the world". Well, now it's officially International. For such persistent and rude little bot it sure doesn't tell you much about itself.
|
koan
msg:3780906 | 10:07 pm on Nov 5, 2008 (gmt 0) |
Just got a visit from them also with the same UA as the original poster:
Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/) It went through 50+ pages with an average of 2 seconds per page. I was also disappointed by their web site. I'm thinking of blocking it by UA... but at least it has one. Not sure.
|
|
