Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Yahoo! Slurp


dstiles - 4:12 pm on Sep 28, 2011 (gmt 0)


Not slurp but closely allied, I think.

Yesterday/today I had a number of hits from a (new to me) IP range allocated to Yahoo Japan - 183.79.0.0/16.

The IPs hit with a bot-like UA including the word "crawler" on 183.79.63.0/24 - specifically between 183.79.63.77 - 183.79.63.110 but probably most of the /24. There were no proper rDNS entries for the bot IPs.

I have found little information about the bot outside of a few logs reported in SERPS and the URL in the UA is in Japanese - if anyone can translate it I'd be interested.

UA: Y!J-BRW/1.0 crawler (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html)


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4360952.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com