OpenindexDeepSpider

another Nutch spider

[dstiles]

IP: 141.105.120.nnn (at least 151 and 153)
UA: Mozilla/5.0 (compatible; OpenindexDeepSpider/Nutch-1.5-dev; +http://www.openindex.io/en/webmasters/spider.html)

Recommendation: Block SE server range for Compukos / DirectVPS at 141.105.120.0 - 141.105.127.255

It did seem to go away when I waved a 403 at it.

[incrediBILL]

Nutch spiders are like locusts as they just swarm all over the web eating everything in their path.

[dstiles]

True. I mentioned it because it's possible they will drop the nutch appellation and because the server range was new to me.

[incrediBILL]

They appear to be some little reseller of DirectVPS (directvps.nl) so if you want to block a lot more servers, I'd go upstream one notch and stop more nutch.

[dstiles]

Below 141.105.120.n is an Irish service, above 141.105.127 is Ukraine. Was that what you meant?