homepage Welcome to WebmasterWorld Guest from 54.235.227.60
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Yahoo! crawler...
pardo




msg:838837
 12:11 pm on Nov 27, 2003 (gmt 0)

I noticed srch4.corp.yahoo.com on our website today. Is this one of their new robots to index for their own search engine database?

 

Rugles




msg:838838
 8:02 pm on Nov 27, 2003 (gmt 0)

No, if I remember correctly the new Yahoo bot is called YahooSeeker.
What you may be seeing is someone searching from the corporate office of yahoo. That is just my guess though.

2_much




msg:838839
 2:48 am on Nov 28, 2003 (gmt 0)

This is for Yahoo Shopping

keyplyr




msg:838840
 12:13 am on Nov 29, 2003 (gmt 0)

I agree Rugles, srch4.corp.yahoo.com originates from Yahoo corporate office.

Yahoo shopping crawler UA is:

YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; h*tp://help.yahoo.com/help/us/shop/merchant/)

mcavic




msg:838841
 1:50 am on Nov 29, 2003 (gmt 0)

Yes, the UA for product search is YahooSeeker/1.0. But it looks like they (1) also run some bots on corporate IP's, and (2) surf sites in connection with product search.

fiestagirl




msg:838842
 1:13 am on Dec 2, 2003 (gmt 0)

I've been seeing one from:
neptune4.search.corp.yahoo.com using the UA: Mozilla/4.0 (compatible; MSIE 6.0)
and one from srch14.corp.yahoo.com using UA: homes/jignashu/units/bin/saisudhir/unity1.pl/0.1 libwww-perl/5.69

twilight47




msg:838843
 3:55 am on Dec 5, 2003 (gmt 0)

Do new yahoo bots mean that Ink will be more than a paid for inclusion SE?

gibEll




msg:838844
 11:47 pm on Jan 5, 2004 (gmt 0)

We had about 40k visits over night and early this morning from:
YahooSeeker/1.0 - sh*.rmi.shop.dcn.yahoo.com (216.109.126.*).

It's unbelievably rude! It was doing nothing but trying to get images that don't even exist on our server, several a second from several diff. ip's. I got it banned in .htaccess, then 4 hours later it started again - only this time it was:
libwww-perl/5.69 from feed21.shop.corp.yahoo.com (207.126.225.175).

Does anyone know a phone number for these people? It's eating up our bandwidth like crazy.

Tim




msg:838845
 6:59 am on Jan 6, 2004 (gmt 0)

Gib,
Please stickymail me the relevant info and hopefully we can resolve this for you.
Tim

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved