Welcome to WebmasterWorld Guest from 54.205.170.21

Forum Moderators: goodroi

Message Too Old, No Replies

Submitting child sitemaps too alongwith sitemap index file ?

sitemap issue for mammoth sites

   
6:52 am on Aug 13, 2010 (gmt 0)

5+ Year Member



We have a rather large site, with 100 million plus records in DB

Iíve created sitemap index file with child sitemaps that confirm to the sitemaps.org protocol.

All the child sitemaps are uploaded to the server and I have submitted the sitemap index file to Google via Google Webmaster Central ( GWC ) account.

My questions are:

1)
In addition to submitting the sitemap index file to Google Webmaster Central, do I need to submit the child site maps too individually?

2)
We have mod rewrite in place and all urlís are search engine friendly along with unique title tags.

Link building activity is underway to increase the link juice at root as well as category level pages.

Is there anything else that can be done to get the maximum number of pages crawled & indexed ?

Any guidance would be highly appreciated. TIA.
-AD
11:15 am on Aug 13, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



#1 - You dont have to submit the sub sitemaps but i would since it takes 5 seconds.

#2 - To boost your page crawling:
a) Do more link development, there is never enough
b) Make sure your pages have great internal links, turn your site into a spider web
c) Boost traffic on your site, google toolbar users can impact your crawling. Some people use PPC to achieve this.
d) Make sure you have SIGNIFICANT & UNIQUE content for every page.
12:13 pm on Aug 13, 2010 (gmt 0)

5+ Year Member



Thanks goodroi for your input - I will submit child sitemaps too then.

Your comment about traffic data affecting crawling is rather interesting. I don't recollect coming across any credible references to that effect but nevertheless, it makes sense.

-AD
2:45 am on Aug 14, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Dont take my word for it. Test it yourself by creating a brand new page with no inbound links. Then visit that page using browsers with google toolbar installed.