Forum Moderators: open
Agent: zermelo Mozilla/5.0 compatible; heritrix/1.12.1 (+http://www.powerset.com) [email:crawl@powerset.com,email:paul@page-store.com]
At that URL they say : "Natural Language Search". I don't know why but I kind of doubt that.
Any other opinions?
To block or not or block?
The key word in the UA is "heritrix" which is the open source that came from ia_archive, somewhat like nutch in the fact that there are hundreds of them out there crawling.