Yahoo Product Search

[mcavic]

Has anyone seen YahooSeeker on their site? Just curious whether it's active yet. This is from the Product Search merchant help:

To specifically prevent Yahoo! from crawling your site, you can add these lines to the /robots.txt file on your server:

User-agent: YahooSeeker
Disallow: /

[Brett_Tabke]

Link Here [help.yahoo.com] and here [help.yahoo.com]

That's the first time that Yahoo has ever run a full blown spider from their site? (other than the 404 morgue checker).

[mcavic]

Aha, here it is...

sh54.rmi.shop.scd.yahoo.com - - [18/Apr/2003:14:51:36 -0500] "GET ... HTTP/1.0" 200 3590 "-" "YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; [search.yahoo.com...]