Forum Moderators: open

Message Too Old, No Replies

Zscho.de Crawler

Nutch Redux

         

Pfui

8:23 pm on Nov 10, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



141.65.161.nn
Zscho.de Crawler/Nutch-1.0-Zscho.de-semantic_patch (Zscho.de Crawler, collecting for machine learning; [zscho.de...]

robots.txt? Yes

Apparently "collecting for machine learning" is just another phrase for this German "alternative search engine."

Pfui

9:22 pm on Dec 27, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



141.65.161.7*
Zscho.de Crawler/Nutch-1.0-Zscho.de-semantic_patch (Zscho.de Crawler, collecting for machine learning; http://zscho.de/)

robots.txt? Yes

Same IP as OP. Bots vs Browsers shows the exact same UA crawling from the above IP as well as multiple neighboring IPs here [botsvsbrowsers.com].