Forum Moderators: Robert Charlton & goodroi
Lastly, I agree with the others that you do no want to implement any type of "Shock and Awe" strategy when adding the new pages.
My suggestion is to make sure that you choose your navigation, urls, titles, and descriptions very carefully before you begin. I suggest spending the extra time now to lay out the entire implementation before you add a single page. You don't want to find yourself in a position where you have put in 5000 url's and you want to change the folder structure, or use dashes in the url instead of hyphen. You also will not want to have the same happen if you want to change titles and descriptions.
Here's what I do: Typically I add large sets of pages dealing with a given widget in one go. The sets are between 30 and 300 pages, with the pages in each set belonging together, as they explain the widget in detail. There is no point in adding parts of a widget, because my visitors would expect to find the whole set of pages and not just a part of it.
I see that the spider discovers the main page of a set and then explores the rest of the new pages. The first pages show up in the index after two to three weeks, and then -rather quickly- more and more pages of a set come up. Typically all pages of a set are included in the index about six to eight weeks after I make them available.
Since then, I've added another couple dozen pages every week or two in three- to ten-page batches.
There does seem to be a penalty against sudden growth spurts, especially from one page to many.
My question: How long will this penalty last?