I hope some of you experts can answer a question for us...
One of our sites has about 40,000 pages which were basically all generated by hand, (employees) and we are thinking of using a service to auto-generate some of our widget's application data, listings, etc... this would add about 300,000 pages or so in one fell swoop.
Question is...should we stagger the introduction of so many pages per week? We just don't want to suddenly drop 300,000 pages in Google's lap only to be slapped in the chops and banned because Googlebot thinks we are trying some spam tactic...
We wonder what the threshold is for a site's growth? Any ideas would be much appreciated. Thanks!
I doubt anyone, short of being a G employee knows, so it's a case of trial and error. However, I do think that 300K pages are a warning that might either penalize you automatically, or require a manual inspection from Google engineers.
Ok, thanks for the replies...it has me worried and I have asked the boss to make SURE he gets with me BEFORE launch so I can check it out fully...it gives me chills to think of what could happen if not done properly...
It depends on the site. For probably 99% of the sites out there adding that many pages will throw up a flag and it will get some sort of penalty which will take a good amount of time to get rid of.
It simply fall under the category of unnatural growth of site no matter how justified you are for adding that many pages.
Scenario usually goes like this:
You start adding the pages, Google starts to index and you even get around 1000 pages indexed and you are happy as a clam then all of a sudden it stops, your old pages start going supplemental, the googlebot still visits new content but it hardly ever gets indexed. I've seen this pattern happen a bunch of times.
Moral of the story, go slow.
[edited by: Aforum at 2:03 pm (utc) on Sep. 22, 2006]