Welcome to WebmasterWorld Guest from 54.162.136.26

Forum Moderators: Robert Charlton & andy langton & goodroi

Message Too Old, No Replies

How best to release 70,000 pages?

     
2:00 pm on Mar 25, 2010 (gmt 0)

New User

5+ Year Member

joined:Oct 6, 2009
posts:40
votes: 0


Hi folks!

We have a jobsite that currently has around 5,000 pages. The new version we are soon to release has a big directory that has been added to it but I am unsure how best to release this? Should we do like 2,000 pages per week, per month, all 70,000 pages all in one go?

What I don't want to happen is for Google or any other SE to suddenly find all of these new pages and then penalise us for it.

Can anyone advise on this please?

Many thanks,

Andy
3:26 pm on Mar 25, 2010 (gmt 0)

Junior Member

5+ Year Member

joined:Aug 11, 2009
posts: 167
votes: 0


A site i work with updates with a new sub-category every once in a while. That usually amounts to 10K-50K pages in one go.

Releasing the pages at the same time has never been a problem, even a few years back when the site was very small and had few links incoming.

Getting those fancy and sought-after deep links, that's the problem... As long as you are publishing good, relevant and above all unique content you should be fine.

Are the 5K old pages also going to stay online? Or do they have a "new" home in the new version? How you choose to do this may well have an affect on your rankings - that is if you are tinkering with the pages and URLs already indexed and ranking.
3:38 pm on Mar 25, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14663
votes: 99


I released 40K pages all at once about a year ago with no penalty.

Google indexed then all in about 3 days.
4:06 pm on Mar 25, 2010 (gmt 0)

Junior Member

10+ Year Member

joined:May 23, 2003
posts:163
votes: 0


launch them and pray
5:12 pm on Mar 25, 2010 (gmt 0)

Preferred Member

5+ Year Member

joined:Nov 13, 2007
posts:607
votes: 0


you will not get a penalty. Just be advised that these pages probably will not rank too high since I am betting these pages do not offer any kind of unique, quality content. What I like to do with scraper/search result type scripts that generate a ton of pages is implement ajax instand edit and hire a content writer to create content for many of the pages.
5:22 pm on Mar 25, 2010 (gmt 0)

Junior Member

5+ Year Member

joined:Apr 22, 2009
posts:44
votes: 0


Two months ago we launched a site with 25k pages. No penalty, indexed under a week.
1:44 pm on Mar 26, 2010 (gmt 0)

New User

5+ Year Member

joined:Mar 26, 2010
posts:13
votes: 0


Let me give a scenario. If you releasing 10K of pages in a day. and these pages are may be url with the keywords and keywords are collected from the search query for which you are getting traffic / from keyword research and the content on this page is displayed from the existing content, then I feel there is an issue. Make sense?

If these 10K pages are pure content (original is great) pages then let me tell you.. you will be loved by Google and other search engines.
1:57 am on Mar 27, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 1, 2004
posts:3181
votes: 0


I thought MC talked about this a couple of years ago and admitted that releasing too many pages too quickly can trigger a penalty. I forget the threshold amount he mentioned...
2:25 am on Mar 27, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


There was that situation in 2006 where Microsoft migrated millions of pages from spaces.msn.com to spaces.live.com. Millions. Here's a tidbit from Matt that seemed to kick off a "too many new URLs" penalty fear:

We saw so many urls suddenly showing up on spaces.live.com that it triggered a flag in our system which requires more trust in individual urls in order for them to rank...

[mattcutts.com...]
But it's a matter of scale here. Millions of new URLs is pretty far beyond 70,000.
10:43 am on Mar 27, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 1, 2004
posts:3181
votes: 0


But it's a matter of scale here. Millions of new URLs is pretty far beyond 70,000.


tedster - thanks for finding that reference. I knew the number was pretty high but I didn't want to throw out a guess. I spent about ten minutes trying to find the reference myself. I couldn't seem to figure out what term to search for... :(
11:35 am on Mar 27, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 25, 2003
posts:2528
votes: 0


The new version we are soon to release has a big directory that has been added to it but I am unsure how best to release this?


My concern is what these pages are. I've never heard of a "directory" of 65,000 pages created instantly unless it was a Dmoz mirror.

Adding 65,000 pages is really a game of internal structure, Pagerank and Trustrank. Of course, if that stuff if thin then no rolling release of any kind will save you from getting tanked in the SERPS.
5:31 pm on Mar 27, 2010 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member themadscientist is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 14, 2008
posts:2910
votes: 62


Has the 5,000 pages a day limit from a few years ago been lifted?

I didn't watch tedster's reference to know if there's something basic and new I'm missing, but I do remember 'back-in-the-day' when we had that GoogleGuy posting there was a statement about 5,000 a day being about the max you wanted to add.
6:22 pm on Mar 27, 2010 (gmt 0)

Moderator

WebmasterWorld Administrator buckworks is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Dec 9, 2001
posts:5702
votes: 76


70,000+ pages is a lot of pages to add ... my concern would be whether the site has enough Page Rank strength to support that many pages effectively.

My opinion would be to add the new pages whenever they're ready, but move cautiously in terms of how you link to them from the rest of the site. You want to give the new sections enough links to make sure the spiders can find them, but you wouldn't want to spread your Page Rank too thin too fast.

Be sure to support the new content with some new link development.
5:49 am on Apr 1, 2010 (gmt 0)

Moderator from AU 

WebmasterWorld Administrator anallawalla is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 3, 2003
posts:3743
votes: 12


In June 2008 I released 2 million new pages that were not previously open to spiders (large directory with a PR8 home page). No problems.
6:29 am on Apr 1, 2010 (gmt 0)

New User

5+ Year Member

joined:Mar 31, 2010
posts:10
votes: 0


I think it is not an issue at all. G is intelligent enough to understand the situation.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members