Mokita - 10:54 pm on Sep 29, 2011 (gmt 0)

dstiles - I don't read Japanese either, but Yahoo's Babelfish does a reasonable job of translating. Albeit somewhat tortured, it is understandable.

Prefacing the majority of user agents is:

* About the crawler
It goes around the web page, the system which you collect & accumulate the contents it calls “the crawler”. Yahoo! JAPAN, the crawler which had the following kind of user agent, with purpose such as utilization and research and development with search service, has done the collection and accumulation of the web page.

Prefacing the last five is this para:

* About the web page verification system
Yahoo!JAPAN The system which had the following kind of user agent for verifying accesses the web page in the web page which is linked from each page of Yahoo!JAPAN. These systems do not do the collection accumulation of the web page.

Is it a complete list? I have no idea. I was only quoting what is on that page in the hope that it is of use to someone.