Forum Moderators: open

Message Too Old, No Replies

YoudaoBot

         

mcneely

8:03 am on Dec 22, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Robots.txt was the very first request that this bot made, before coming in to spider albeit ever so slowly, all of what we had to say about how people would abuse parsing utilities.

It came in on a stroll from 61.135.249.*.

So far so good I think. And yes, I've seen some of the unfavourable posts about the bot in some Webmasterworld 2006 threads.

It's a mixed bag I think, with some of these eastern bots, in that I've had a good bout of luck with Yandex, and even though the Baiduspider has been stuck in a rather odd loop for the past few weeks on a few of our sites (only requesting robots.txt and (/) ), I still get a bit of decent traffic from both.

keyplyr

9:56 pm on Dec 22, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I been allowing YoudaoBot. The owner posted here at WW which is always a good sign they aren't trying to hide from accountability.

YoudaoBot has been going crazy with my image file directories, but is following robots.txt directives.

Always a risk to allow such open access when the services are as yet unpublished so I'm keeping a pretty vigilant eye on them.

keyplyr

12:47 am on Dec 23, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



[Correction to my above post]

My bad. It was the Yanga owner that posted, not YoudaoBot.

jdMorgan

3:07 am on Dec 23, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Question: Is this Yodaobot, or Youdaobot?

If the latter, then it's either a new 'bot to me, or a variant westernized spelling of the same 'bot previously calling itself Yodaobot...

Thanks,
Jim

blend27

10:50 am on Dec 23, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



61.135.220.nnn Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
61.135.219.nnn Mozilla/5.0 (compatible;YodaoBot-Image/1.0;http://www.yodao.com/help/webmaster/spider/;)

I've looked for English version of explanation on their website of what it is on the site but did not find any. Did a quick search for a important keyword, top 50 returns ALL .CN Domains, and kind of never looked back.

[edited by: eelixduppy at 7:09 pm (utc) on Dec. 24, 2008]
[edit reason] disabled smileys [/edit]

mcneely

12:26 pm on Dec 23, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



yodao redirects to youdao

Here's a bit on their Robots.txt;

Suggested that you deposit a robots.txt document under the stand root directory. Our reptile when first time captures your stand will first confirm whether under the root directory to have the robots.txt document. For example, your website address is www.example.com, we will first capture http://www.example.com/robots.txt to carry on the following operation again. If is unable to visit the robots.txt document, the system tacitly approves for your stand each link may capture.

[babelfish.yahoo.com...]

I may not have exactly pulled the best or the brightest translation out of the Yahoo Babel Fish (Chinese-trad to English), what with regard to their *reptile and all of that, but it is a translation nonetheless.