Google restricting new indexing to 5k pages a week?

Indexing large sites

[Whitey]

Are there any folks out there who can throw some light on their experiences of managing large sites and launching lot's of new pages?

Matt's video [video.google.com...] contained some lines about the very slow introduction of pages for large sites to the index.

He spoke about a site which wanted to release over 1M pages and cautioned the release of the pages to around 5k a week. He also spoke about Wikipedia which was at the upper limits, having 5M pages.

This means [ forgive the elementary maths - i just want to make a point ] it will take :

2M pages = 400 weeks [ say 8 years ]
1M pages = 200 weeks [ say 4 years ]
500k pages = 100 weeks [ say 2 years ]
250k pages = 50 weeks
125k pages = 25 weeks

Does that mean no more large site launches?

[Whitey]

I thought i might have a few more replies on this, so taking things a step further and in the context of widespread alterations and additions [ e.g. mass 301 redirects, page increases ] fall into the same category of triggering flags & penalties.

Matt is saying that it will take "a long time " for those sites to recover, that have launched large page numbers.

This is "scary monster territory" for large sites, which needs some clarification in the context of dynamic page generation/alterations.

[edited by: Whitey at 2:54 am (utc) on Aug. 17, 2006]