Forum Moderators: open

Message Too Old, No Replies

"ichiro/2.0 (ichiro@nttr.co.jp)"

masquerading as a mobile phone

         

zCat

6:56 am on Nov 1, 2005 (gmt 0)

10+ Year Member



Recently I was trawling through the site logs (for a Japanese language site I'm charged with caring for) looking for bots and scrapers to ban, and discovered this particular chap: "DoCoMo/2.0 P900i(c100;TB;W24H11)", who appears to be a very prolific mobile phone user (several thousand hits in the space of a few hours).

The IP traces to "NTT Resonant Incorporated", and the logs reveal hits from the same IP with the UA "ichiro/2.0 (ichiro@nttr.co.jp)", which AFAIK is the bot behind www.goo.ne.jp . Does anyone know what NTTR / goo (now there's a brandname you wouldn't want to expand into the English speaking world with ;-) ) are up to with this keitai masquerading?

gothic

7:40 pm on Nov 6, 2005 (gmt 0)



We got the same bot having a spider frenzy, got the following back after a bit of investigation
ichiro/2.0 (ichiro@nttr.co.jp)
&
Goo Japan / Inktomi robot (210.173.179.xx), s. also moget / mogimogi
and all led back to: [goo.ne.jp...]

Riamus

7:19 pm on Nov 14, 2005 (gmt 0)

10+ Year Member



Is this a spider that serves a purpose? I mean, does it really allow the search site to search your own site? It seems associated with Inktomi, which should be an acceptable bot. Granted this one does crawl my site a LOT, but I'm not concerned about that... I have the bandwidth for it. If it's a useful bot to have, when a site does have a Japanese market (somewhat), then I want to keep allowing it. Anyone know for sure?

zCat

10:37 pm on Dec 17, 2005 (gmt 0)

10+ Year Member



Just a followup: I've noticed that since a few days, ichiro has is now crawling as
ichiro/2.0 (http://help.goo.ne.jp/door/crawler.html)
.

The page behind the link confirms it's NTT Resonant's (?) crawler for for the following sites:
[mmm.nttr.co.jp...]
[mobile.mmm.nttr.co.jp...]
[mobile.goo.ne.jp...]
and also contains the usual info their crawler for webmasters (what it spiders, how to block it etc.), albeit in Japanese only.

zCat

10:31 am on Jan 4, 2006 (gmt 0)

10+ Year Member



And just to follow up on that: in the above list [mmm.nttr.co.jp...] has been replaced by
[bsearch.goo.ne.jp...] which seems to be a multimedia search engine, which I actually got a hit from.

(That reminds me: I must adapt my site code so that hits on media files from search engine results display the file in its page context, rather than just showing the file)

otech

12:50 pm on Jan 8, 2006 (gmt 0)

10+ Year Member



I too have seen ichiro on my site and after reading up a bit discovered if is for one of Japans leading telephone companies search engine - it doesnt come around often so I dont mind it visiting, but is probably of little value to sites offering content irrelevant to Japan.