Forum Moderators: open

Message Too Old, No Replies

bangalore.corp.yahoo.com? Is this a legitimate yahoo spider?

global-pix1.bangalore.corp.yahoo.com

         

Osian

7:29 pm on Nov 1, 2004 (gmt 0)



Hello,
I am a first time poster, so please forgive me if this is not the right forum for this...

On 10/30/04 a spider began submitting a web form I have on my site. It is a very basic form, no javascript vaidation, just a few text, radio and checkbox inputs and a standard submit button. The contents of the form are then emailed to me. This spider submitted the form repeatedly for about 3 hours sending me hundreds of messages until I disabled the form upon receiving all that mail.

So, my question is: Is this a legitimate spider from yahoo?

IP: 202.46.19.93
DNS: global-pix1.bangalore.corp.yahoo.com
User Agent: Mozilla/5.0+(compatible;+Konqueror/3.2;+FreeBSD)+(KHTML,+like+Gecko)

It doesn't seem like one to me because of it's behaivor and it's user agent.

Anyone know where to complain about this behavior to yahoo at?

I have never seen a yahoo bot that actually submits forms (post method). The bot started cralling my site on 10/29 and got the robots.txt first thing. It then proceeded to spider the site as a normal bot would. However, it did request a few pages repeatedly in a row and requested a few pages that have been gone for a while. I don't beleive the deleted pages that it requested are linked to anywhere on my site. It spidered me for almost a day before it started submitting this form repeatedly. When I disabled the form, it stopped. I then banned that IP from the site and it has since come back 4 times but not spidered any further.

Anyone ever see this spider before?

Thanks in advance.

jdMorgan

12:52 am on Nov 6, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



From what I can see, this is simply an abusive user-agent connecting through a Yahoo ISP or hosting service in Bangalore.

Jim