Welcome to WebmasterWorld Guest from 50.17.16.177

Message Too Old, No Replies

Indexing a big website at once

Upload a big site at once or add pages slowly?

     
6:28 pm on Oct 16, 2006 (gmt 0)

New User

10+ Year Member

joined:May 15, 2003
posts:28
votes: 0


Hello,

I am working on a big resource site for a long time now which has reached the site of a couple of thousand pages. The idea was to upload all pages at once and let google index all pages as fast as possible.

But.... is this a smart thing to do from a ranking point of view? Won't google "see" my site as a big spam site?

Are their any webmasters who have experience with indexing a big site at once? Please share your experiences and thoughts on this one.

Thanks.

7:44 pm on Oct 16, 2006 (gmt 0)

New User

5+ Year Member

joined:Oct 16, 2006
posts:3
votes: 0


The idea was to upload all pages at once and let google index all pages as fast as possible.

From my experience if you make a bulk upload google will take more time to index the whole content, with even less accuracy. A better solution is to schedule the upload and eventually update the sitemap at the same time.

For instance, if you have 2500 pages you can "upload" 50 pages a day, update the sitemap and send a ping to google web site (on different daily times). Doing so, in just 2 month you will get the whole content fully indexed. I have already done this on 4 vertical blogs and I have get great results.

Sincerely,
Filippo Toso

8:18 pm on Oct 16, 2006 (gmt 0)

Junior Member

10+ Year Member

joined:July 22, 2005
posts:151
votes: 0


I have uploaded 8,000 pages at once, and submitted a sitemap to both Google and Yahoo. Within 15 days, Google crawled +2000 pages, yahoo crawled +1800 pages thus far. site: command shows 40 pages in Google, 100 pages in Yahoo. The site in question has a PR5. Although both engines are fast in crawling, they are somehow slow in integrating the pages into their index.