HTML Analyzer

using Nutch

[keyplyr]

UA: HTML Analyzer/Nutch-1.12
Protocol: HTTP/1.1
Robots.txt: Yes
Host: University of Coimbra, Portugal
193.136.212.0 - 193.136.212.255
193.136.212.0/24

[keyplyr]

Although I block "Nutch" because of the wide & unaccountable usage, I do like the fact that the default setting supports robots.txt.

[tangor]

I block nutch simply because more serious projects tend to use something other than nutch. However if one has the time and energy to evaluate each on its merits then it would make sense to poke holes when reasonable.

[keyplyr]

Yes, I think I allow 5 or 6 to use Nutch.