Forum Moderators: open

Message Too Old, No Replies

Factors affecting depth of indexing

How many pages of a large site will be indexed?

         

Sierra_Dad

5:00 am on Jul 27, 2005 (gmt 0)

10+ Year Member



Suppose a site has been conceptualized that has 2 million pages. Suppose they have unique titles and urls and are well linked together in categories, subcategories, etc.

How likely is it that Google, Yahoo, MSN, will index all of those pages?

For instance, they do index about 61 million pages at Amazon.com.

Some factors I can think of are:

1. PageRank of top level or category pages.
2. Uniqueness of title and description meta tags from each other.
3. Uniqueness of textual content of each page within the site.
4. Uniqueness of textual content from other pages on the web.
5. Link popularity of individual pages. (ie deep external links trigger indexing)

Is there any other factors to consider? Which of these are most important?

Sierra_Dad

10:11 pm on Jul 27, 2005 (gmt 0)

10+ Year Member



I found some good previous discussions on this topic in this forum.

For #1,
Many were of the opinion that a site with PR6 at the home pages could get about 50K pages indexed easily. One would need to aim for higher PR for more than that.

Given those odds, it may be more worthwhile to concentrate on getting some higher level categories indexed, and optimise from there. Even getting PR6 will take some time to achieve.