Forum Moderators: open

Message Too Old, No Replies

YodaoBot

         

Pfui

10:13 pm on Aug 16, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



An old-timer [google.com...] I see almost every day on one site, and intermittently on others. It NEVER behaves so I thought I'd re-mention it.

Note also the poorly coded UA ending, including that space before the close-paren:

Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )

Runs from (partial listing):

61.135.248.185
61.135.249.153
61.135.249.190
61.135.249.214
61.135.249.244

robtex says yodao.com has five IP numbers 61.135.218. range so this bot appears to be running from, if not part of its Chinese mothership, at least a close neighbor.

robots.txt? Once from one of its IPs -- and promptly ignored.

phranque

11:19 am on Aug 17, 2011 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



going through an old log file and happened to notice YodaoBot, also running from:
61.135.248.172
61.135.249.59

also noted this misspelled(?) version of UA:
Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )

running from:
61.135.249.202

other than /robots.txt and / they only were interested in video files.

[edited by: tedster at 1:03 am (utc) on Aug 19, 2011]

lucy24

12:03 pm on Aug 17, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Don't recognize the name, but my htaccess says
61.128.0.0/10
so I must have met them at some time. Or possibly a neighbor from an adjoining province.

tangor

11:46 pm on Aug 17, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Oddly (I have no videos) YodaoBot has been well-behaved AS THE BOT... I get, via the same ips, all kinds of UAs and those are blocked...

wilderness

11:56 pm on Aug 17, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



61.135.249.221 - - [11/Feb/2010:03:04:36 +0000] "GET /robots.txt HTTP/1.1" 200 5046 "-" "Mozilla/5.0 (compatible; YoudaoBot/1.0; http: //www.youdao.com/help/webmaster/spider/; )"
61.135.249.221 - - [11/Feb/2010:03:04:37 +0000] "GET / HTTP/1.1" 403 878 "-" "Mozilla/5.0 (compatible; YoudaoBot/1.0; http: //www.youdao.com/help/webmaster/spider/; )"

Unfortunately when they visited me (above) the bot encountered three denys"

"spider"
trailing blank space
61.

dstiles

7:31 pm on Aug 18, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've had 61.135.128/17 blocked for a long time so not seeing that bot. And there appears to be no valid rDNS for it.

Pfui

1:16 am on Aug 29, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



FWIW, another neighboring IP:

61.135.249.182
Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )

robots.txt? NO