Welcome to WebmasterWorld Guest from 54.162.214.65

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo! crawler...

     
12:11 pm on Nov 27, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Oct 16, 2002
posts:205
votes: 0


I noticed srch4.corp.yahoo.com on our website today. Is this one of their new robots to index for their own search engine database?
8:02 pm on Nov 27, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2001
posts:2145
votes: 0


No, if I remember correctly the new Yahoo bot is called YahooSeeker.
What you may be seeing is someone searching from the corporate office of yahoo. That is just my guess though.
2:48 am on Nov 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Aug 12, 2000
posts:1808
votes: 0


This is for Yahoo Shopping
12:13 am on Nov 29, 2003 (gmt 0)

Moderator from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:6412
votes: 100


I agree Rugles, srch4.corp.yahoo.com originates from Yahoo corporate office.

Yahoo shopping crawler UA is:


YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; h*tp://help.yahoo.com/help/us/shop/merchant/)
1:50 am on Nov 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 31, 2003
posts:1316
votes: 0


Yes, the UA for product search is YahooSeeker/1.0. But it looks like they (1) also run some bots on corporate IP's, and (2) surf sites in connection with product search.
1:13 am on Dec 2, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:May 14, 2002
posts:378
votes: 0


I've been seeing one from:
neptune4.search.corp.yahoo.com using the UA: Mozilla/4.0 (compatible; MSIE 6.0)
and one from srch14.corp.yahoo.com using UA: homes/jignashu/units/bin/saisudhir/unity1.pl/0.1 libwww-perl/5.69
3:55 am on Dec 5, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Apr 22, 2003
posts:250
votes: 0


Do new yahoo bots mean that Ink will be more than a paid for inclusion SE?
11:47 pm on Jan 5, 2004 (gmt 0)

New User

10+ Year Member

joined:Jan 24, 2003
posts:11
votes: 0


We had about 40k visits over night and early this morning from:
YahooSeeker/1.0 - sh*.rmi.shop.dcn.yahoo.com (216.109.126.*).

It's unbelievably rude! It was doing nothing but trying to get images that don't even exist on our server, several a second from several diff. ip's. I got it banned in .htaccess, then 4 hours later it started again - only this time it was:
libwww-perl/5.69 from feed21.shop.corp.yahoo.com (207.126.225.175).

Does anyone know a phone number for these people? It's eating up our bandwidth like crazy.

Tim

6:59 am on Jan 6, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Feb 27, 2002
posts:351
votes: 0


Gib,
Please stickymail me the relevant info and hopefully we can resolve this for you.
Tim