| 1:31 pm on Jan 26, 2012 (gmt 0)|
Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
canonical name: hosted-by.leaseweb.com
inetnum: 184.108.40.206 - 220.127.116.11
descr: P.O. Box 93054
descr: 1090BB AMSTERDAM
Dang .. didn't have that one blocked :(
990 unique URL's in 1 hour.
Requested URL's that don't exist, even tried remote file inclusion in the URL ...
Tried to change the language on the site, a feature not implented. Performed an exotic search too.
About 1 year ago I changend the format of the URL's, from a non HTML extension to a HTML extension and it still did request the "old format" for certain URL's. Almost like it did scrape them from elsewhere ...
Anyway, just like Purebot it gained a lifetime ban from our sites.
| 4:34 pm on Jan 26, 2012 (gmt 0)|
FWIW: "hosted-by.leaseweb.com" is a nasty catch-all. A month ago, its IP on one of my sites was 18.104.22.168 (Just in case, here ya go: 22.214.171.124/20:)
| 8:31 pm on Jan 26, 2012 (gmt 0)|
Ha - had both ranges already blocked.
| 9:49 pm on Jan 26, 2012 (gmt 0)|
Huh. I just recently met that name for the first time, but mine's from 126.96.36.199 (UK, I think, though I've seen a couple ranges recently that seem unsure what country they belong to).
Must have been tired when it visited me. Just robots.txt and then the front page-- or rather, not the front page. Asked for the without-www version after getting robots.txt on the correct with-www side, got an automatic 301 and then never bothered coming back. ::shrug::
| 1:50 am on Jan 27, 2012 (gmt 0)|
Thanks Lucy, I didn't have this range:
188.8.131.52 - 184.108.40.206
| 3:01 am on Jan 27, 2012 (gmt 0)|
Thanks Pfui and Lucy, added both ranges.
NetRange: 220.127.116.11 - 18.104.22.168
owner-organization: Ocom B.V.
owner-street: J.W. Lucasweg 35
| 10:45 pm on Jan 27, 2012 (gmt 0)|
Lucy - the range is assigned to NL, although users throughout the world often use NL facilities.
I have the specific IP range 22.214.171.124 - 126.96.36.199 as being Purebot; could be a name change.
Anyway, I have the range 188.8.131.52 - 184.108.40.206 banned. Likewise the leaseweb junk.