Forum Moderators: open

Message Too Old, No Replies

Yahoo bot?

         

webzilla

4:24 am on Aug 2, 2005 (gmt 0)

10+ Year Member



Is this really a Yahoo bot?

Don't remember ever seeing this one until the past week or so:

"WebIndexer/1-dev (Web Indexer; mailto://webindexerv1@yahoo.com; webindexerv1@yahoo.com)"

wilderness

4:36 am on Aug 2, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



[google.com...]

Using the search method that balam provided in Msg#10 of this thread:
[webmasterworld.com...]

volatilegx

2:23 pm on Aug 2, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Short answer: I don't think it is, webzilla.

eeek

9:05 pm on Aug 12, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Whatever it is, it sure is stupid when it comes to using the Location: header.

keyplyr

11:44 pm on Aug 12, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



WebIndexer/1-dev is the bot from World Lingo, an online translating service. They prefetch popular webpages that either use their service or that users submit a lot. Their UA string does identify contact info as webindexerv1@yahoo.com, but AFAIK there's no connection.

GaryK

1:30 pm on Aug 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I could not get WordLingo's free URL translation service to work; it kept throwing errors. So I could not verify their user agent.

Keyplyr is probably right about WordLingo.

Just to be safe I wanted to add there is a nasty little site ripper that calls itself WebIndexer and the user agent is 100% customizable.

I sent an e-mail to the address in the user agent. I'll let you know what I find out.

keyplyr

6:18 pm on Aug 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I could not get WordLingo... to work... So I could not verify their user agent. Keyplyr is probably right about WordLingo.

I've been using their service for 3 years.

...there is a nasty little site ripper that calls itself WebIndexer and the user agent is 100% customizable.

As are most :)

While WebIndexer/1-dev is the bot from World Lingo, what may be calling itself this may of course be anything from anywhere. If it's from World Lingo, the IP will verify it.

GaryK

6:24 pm on Aug 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've been using their free service for 3 years.

I should have been more specific. :)

Their text translator works fine. It's the one where you enter a URL that the website throws an error:

An Error has occurred whilst trying to process your service request.
Error Details:
Unable to connect to specified website.
Code: 76

I get the above error regardless of what URL I enter. Is that happening to you too?

keyplyr

9:59 pm on Aug 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




Gary - sticky sent

An Error has occurred whilst trying to process your service request.
Error Details:
Unable to connect to specified website.
Code: 76

Make sure you have referrer logging and JS enabled :)

GaryK

10:24 pm on Aug 14, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks so much. The user agent in question is definitely World Lingo.

Riamus

8:28 pm on Aug 15, 2005 (gmt 0)

10+ Year Member



I saw this as well... I checked the IP and it brought up some other company out of Wisconsin, so it wasn't a World Lingo bot unless they are using another company's IP. :(

GaryK

12:20 am on Aug 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The IP Address the bot used when I had it translate one of my pages yesterday was also registered to a hosting company in Green Bay, WI called Netsonic. :)