Welcome to WebmasterWorld Guest from 54.147.217.76

Message Too Old, No Replies

Indexing a big website at once

Upload a big site at once or add pages slowly?

   
6:28 pm on Oct 16, 2006 (gmt 0)

10+ Year Member



Hello,

I am working on a big resource site for a long time now which has reached the site of a couple of thousand pages. The idea was to upload all pages at once and let google index all pages as fast as possible.

But.... is this a smart thing to do from a ranking point of view? Won't google "see" my site as a big spam site?

Are their any webmasters who have experience with indexing a big site at once? Please share your experiences and thoughts on this one.

Thanks.

7:44 pm on Oct 16, 2006 (gmt 0)

5+ Year Member



The idea was to upload all pages at once and let google index all pages as fast as possible.

From my experience if you make a bulk upload google will take more time to index the whole content, with even less accuracy. A better solution is to schedule the upload and eventually update the sitemap at the same time.

For instance, if you have 2500 pages you can "upload" 50 pages a day, update the sitemap and send a ping to google web site (on different daily times). Doing so, in just 2 month you will get the whole content fully indexed. I have already done this on 4 vertical blogs and I have get great results.

Sincerely,
Filippo Toso

8:18 pm on Oct 16, 2006 (gmt 0)

5+ Year Member



I have uploaded 8,000 pages at once, and submitted a sitemap to both Google and Yahoo. Within 15 days, Google crawled +2000 pages, yahoo crawled +1800 pages thus far. site: command shows 40 pages in Google, 100 pages in Yahoo. The site in question has a PR5. Although both engines are fast in crawling, they are somehow slow in integrating the pages into their index.