I am working on a big resource site for a long time now which has reached the site of a couple of thousand pages. The idea was to upload all pages at once and let google index all pages as fast as possible.
But.... is this a smart thing to do from a ranking point of view? Won't google "see" my site as a big spam site?
Are their any webmasters who have experience with indexing a big site at once? Please share your experiences and thoughts on this one.
The idea was to upload all pages at once and let google index all pages as fast as possible.
From my experience if you make a bulk upload google will take more time to index the whole content, with even less accuracy. A better solution is to schedule the upload and eventually update the sitemap at the same time.
For instance, if you have 2500 pages you can "upload" 50 pages a day, update the sitemap and send a ping to google web site (on different daily times). Doing so, in just 2 month you will get the whole content fully indexed. I have already done this on 4 vertical blogs and I have get great results.
I have uploaded 8,000 pages at once, and submitted a sitemap to both Google and Yahoo. Within 15 days, Google crawled +2000 pages, yahoo crawled +1800 pages thus far. site: command shows 40 pages in Google, 100 pages in Yahoo. The site in question has a PR5. Although both engines are fast in crawling, they are somehow slow in integrating the pages into their index.