incrediBILL - 8:26 pm on May 30, 2012 (gmt 0)
Ah, so it was actually 80legs?
That's sad as I'd rather think that some other botnet was faking their UA than they were ignoring robots.txt.
Oh well, another one goes south.
Not like I didn't predict when this thing first surfaced that eventually the desire to collect the data would exceed their desire to honor robots.txt.
What happens next when they stop announcing their user agent and use a common browser user agent like the botnet that attacked sites owned by a few of our members a month or so ago?
Then you won't even know who to contact, which will be preferable for them to stem the tide of complaints.