Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Inclusion Program

Trying to clear up some misunderstanding in this forum



10:02 pm on Feb 27, 2004 (gmt 0)

10+ Year Member

The primary means of generating our index is via our free crawl, using our new Yahoo! Slurp crawler. Yahoo! Slurp discovers pages by following links on the web. We update our index with a daily crawl to gather newly created and fast-changing URLs, as well as our main crawl which updates our index incrementally twice per week.

We supplement this free crawl with the paid inclusion program, which allows us to add dynamic database content and other content that we could not otherwise discover and crawl. Currently less than 1% of our index is content that is included via our inclusion programs.

Our paid inclusion programs provide a superior way for sites to interact with us in a clearly structured fashion. These sites get the following
1) Control over which URLs they include in the index (subject to content
2) Frequent refresh
3) Clearly defined way to interact with us (for example: clear feed
4) Quality review and consultation (for feed customers)
5) Detailed reporting to track and optimize performance
6) Customer service

Participation in Yahoo!'s paid inclusion program does not guarantee rank in the search results. URLs are ranked in search results in the same way as all other URLs from the free crawl. The key drivers of ranking are keyword-specific relevance and site quality, as assessed by our regular search relevance algorithms with input from the quality review process.

(Note that Inktomi Index Connect clients are receiving Yahoo! Search traffic going forward, and Inktomi Search Submit customers are receiving a free trial of Yahoo! traffic until 4/15/04.)

We will also be launching free URL submission during the week of 3/1. This service allows content providers to suggest that the crawler should visit a site during the main crawl cycle. This service is different than paid inclusion in two ways:

1) There is no guarantee that we will crawl and include the URL in the index.
2) As this site potentially could be added to the main crawl, Yahoo! Slurp will follow links from that URL.

This service will reside on the Yahoo.com site and be accessible via a Yahoo! login. This service has been available for the AltaVista and Alltheweb Indices previously and the tradition will continue with Yahoo! Search.


11:16 pm on Mar 7, 2004 (gmt 0)

10+ Year Member

It is similar to unsubscribing. If your page is in for free then your free page will be shown when your account runs out. If you are not in for free then your page will drop out of the index. Fairly straightforward. This also answers the question for people: how do I know if my paid page is also in the free crawl?


11:19 pm on Mar 7, 2004 (gmt 0)

10+ Year Member

STcrim can you be more specific I am not sure I understand your question.
The only thing that I understand from your post is: Will SiteMatch be offered to large content providers? I am not sure if that is what you mean to be asking.


11:34 pm on Mar 7, 2004 (gmt 0)

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member

It's been a long thread, many interesting points have been made. Tim has answered many questions from this and other threads over here:
This 423 message thread spans 15 pages: 423

Featured Threads

Hot Threads This Week

Hot Threads This Month