Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

How many pages is it safe to add at one time?

         

Uber_SEO

8:20 am on Oct 13, 2009 (gmt 0)

10+ Year Member Top Contributors Of The Month



I work for a very large website, which currently has just over 1 million pages indexed within Google. We're working on a project to publish about 400,000 pages of copy.

What kind of rollout do you think is required to avoid us tripping some kind of automatic penalty within Google?

Lots of people have suggested to do it in a staged manner, but what exactly is a staged manner? Should I be releasing 1000 pages every day, or batches of 10,000 pages once a week. What's too much? What's too little? Does anyone out there have any interesting case studies on a similar project?

FranticFish

4:23 pm on Oct 13, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



[webmasterworld.com...]
[webmasterworld.com...]

and an older thread from 2006 (http://www.webmasterworld.com/google/3070792.htm)

There's another recent thread I can't find that contained some very good advice. The gist of it was this...

If you're adding pages daily and pushing the limit, remember that Google might not crawl every day, so it could 'discover' 2 or 3 or more times the number of 'new' pages you intend it to.

tedster

7:24 pm on Oct 13, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



One thing is very important when rolling out a major new collection of content - eliminate those duplicate urls before you do, otherwise your rollout looks 2x, 5x, 10x as big as it really is.

For this reason I would stage the rollout progressively, not just in time but also in size. Start with 1,000 and monitor for a week. If all is well, rollout 10,000 the next week and monitor results for another week. If you've got 1 million urls indexed, then you've probably got pretty good trust with Google and you can push the next week to the area of 40,000 or so.

If you need to debug anywhere along the line, then stay at that level until that rollout is clean, and the next one of the same size. Once you get a clean new rollout, then up the number of urls for the next one.

If these new urls are organized into a set of directories, a few new links to the tp pages of those directories would be a very good idea.

Uber_SEO

11:10 am on Oct 14, 2009 (gmt 0)

10+ Year Member Top Contributors Of The Month



Cheers guys - thanks for your help :)