Welcome to WebmasterWorld Guest from 54.167.83.224

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

YahooSeeker/1.0

     
2:54 am on Aug 13, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:July 19, 2002
posts:173
votes: 0


Does this spider belong to Yahoo!? It produced 10652 hits on my site since the beginning of August.
3:12 am on Aug 13, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 15, 2003
posts:2395
votes: 0


what's the IP-address? and btw. does it obey robots.txt?
11:14 am on Aug 23, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 15, 2003
posts:169
votes: 0


More information about it here: [search.yahoo.com...]

This is the IP 216.109.126.143 and reverse DNS sh19.rmi.shop.dcn.yahoo.com
It appeared like this in a log I found YahooSeeker/1.0(Mozilla4.0;MSIE5.5;http://search.yahoo.com/yahooseeker.html)

Rob

12:02 pm on Aug 23, 2003 (gmt 0)

New User

10+ Year Member

joined:Aug 4, 2003
posts:26
votes: 0


no idea
12:58 pm on Aug 23, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 12, 2003
posts:32
votes: 0


Looks like yahoo's version of froogle
8:45 pm on Aug 23, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 2, 2002
posts:792
votes: 0


that URL redirects

but on further investigation the following is found:

Yahoo! Product Search is a new beta search tool designed to help consumers find a comprehensive listing of products available on the Web. Product Search enables consumers to search through millions of items from thousands of merchants, to find, compare, and buy almost anything.

2:11 am on Aug 24, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 3, 2003
posts:7
votes: 0


products.yahoo.com/ is the url for this new beta service
6:09 am on Aug 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Aug 19, 2003
posts:701
votes: 0


*!@!, just checked it out....my worst nightmare come true.

Worse than google adwords, because Yahoo gives the option to sort prices 'low to high'.

If these things ever catch on, we'll have to 'thank them' for all the bandwidth they'll save us, because potential customers will no longer have to be inconvenienced with actually coming to our website.

Can you say 'price war' among your dumbest competitors?

7:40 am on Aug 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 1, 2002
posts:1580
votes: 0


More evidence that Yahoo is going to ditch Google and compete with it at every level.....bring it on big y!...we all need it!
7:50 am on Aug 24, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 29, 2002
posts:100
votes: 0


jeff weiner of Yahoo Search did mention (at SES san jose) that they were very pleased with their new product comparison product and I guess this is what he was referring to. I think digitial cameras was the example.

From what I gathered, I think they are doing site/product with separate crawlers of some type to handle the structured data.

TGN

8:56 am on Aug 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 2, 2002
posts:792
votes: 0


they have a long way to go with their technology.
When you do a price sort for hardware, for example iPod 15gb, then 1st you get all the accessories, then you get the devices.

I think they need to lay down very clear lines to merchants on how to set-up the datafeed, and then get a majority of their content in data-feeds before launching the search. Otherwise customers will come to them and run away because of the irrelevant results.

A whole new world of SEO

9:14 am on Aug 24, 2003 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5797
votes: 64


...they need to lay down very clear lines to merchants on how to set-up the datafeed, and then get a majority of their content in data-feeds...

Yup - that's how they do it. When you sign up, you get instructions for the datafeed: code, product-url, name, description, price, image-ur, shopping-category, upc, condition, classification, availability, isbn, medium, and language.

8:47 pm on Aug 25, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Nov 6, 2001
posts:275
votes: 0


In an agreement they're mailing out they mention the public lauch date as September 23, 2003 (or October 15, 2003, not quite sure)?
7:25 am on Aug 26, 2003 (gmt 0)

New User

joined:Apr 29, 2015
posts:
votes: 0



How does one get invited to participate? Is it for Yahoo Store companies only, or for everyone? Any URL where i can get more information?

Thanks in advance,
seoboy

8:08 am on Aug 26, 2003 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:5797
votes: 64


How does one get invited to participate? Is it for Yahoo Store companies only, or for everyone? Any URL where i can get more information? seoboy

[products.yahoo.com...]

3:18 pm on Sept 8, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 6, 2002
posts:742
votes: 0


Saw several ads on NFL Football about this yesterday. Looks like they are going full speed ahead. Also, received several hundred spider hits from Yahooseeker yesterday.
12:31 pm on Sept 11, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:July 2, 2002
posts:529
votes: 0


Holy cow batman this YahooSeeker bot has just hit my site over 4000 times! Perhaps I have my robots.txt wrong, but is it correct to exclude a dynamic page, which will later be used with extra parameters like this:

disallow:page.asp

Should that stop a bot from getting page.asp?id=1 or have I got this bit wrong? :(

For me, I dont see the harm in the pages it has taken, it may actually be very beneficial. If Yahoo's new search (I assume they're building an engine around this?) is anything like google's technology it may make a nice test-bed for me to un-exclude these pages anyway :) But are they violating robots.txt?

Cool, just noticed they're getting movies too! :)

10:06 pm on Oct 7, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 27, 2001
posts:2547
votes: 0


Had to ban YahooSeeker in .htaccess
I didn't have rules set up in robots.txt but this thing was *hammering* my site. Some dynamic pages on my site take a while to load so instead of waiting/giving up this thing just keeps going for it! Needless to say my little site couldn't handle it.
Checked yahoo's product search and couldn't see myself in there so why suffer the hammering if I'm getting nothing out of it? If anyone starts to see profits from YahooSeeker spidering effects please let me know though.
3:28 am on Nov 2, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 5, 2003
posts:807
votes: 0


I got 214 files indexed. I see that one out of the last 100 pageviews came from there, though I think that was me checking out one of my own links.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members