Welcome to WebmasterWorld Guest from 22.214.171.124 , register , login , search , subscribe , help , library , PubCon , announcements , recent posts , open posts Subscribe to WebmasterWorld
Submitting child sitemaps too alongwith sitemap index file ? sitemap issue for mammoth sites OMZen msg:4186360 6:52 am on Aug 13, 2010 (gmt 0) We have a rather large site, with 100 million plus records in DB Iíve created sitemap index file with child sitemaps that confirm to the sitemaps.org protocol. All the child sitemaps are uploaded to the server and I have submitted the sitemap index file to Google via Google Webmaster Central ( GWC ) account. My questions are: 1) In addition to submitting the sitemap index file to Google Webmaster Central, do I need to submit the child site maps too individually? 2) We have mod rewrite in place and all urlís are search engine friendly along with unique title tags. Link building activity is underway to increase the link juice at root as well as category level pages. Is there anything else that can be done to get the maximum number of pages crawled & indexed ? Any guidance would be highly appreciated. TIA. -AD
goodroi msg:4186438 11:15 am on Aug 13, 2010 (gmt 0)
#1 - You dont have to submit the sub sitemaps but i would since it takes 5 seconds. #2 - To boost your page crawling: a) Do more link development, there is never enough b) Make sure your pages have great internal links, turn your site into a spider web c) Boost traffic on your site, google toolbar users can impact your crawling. Some people use PPC to achieve this. d) Make sure you have SIGNIFICANT & UNIQUE content for every page. OMZen msg:4186466 12:13 pm on Aug 13, 2010 (gmt 0)
Thanks goodroi for your input - I will submit child sitemaps too then. Your comment about traffic data affecting crawling is rather interesting. I don't recollect coming across any credible references to that effect but nevertheless, it makes sense. -AD goodroi msg:4186901 2:45 am on Aug 14, 2010 (gmt 0)
Dont take my word for it. Test it yourself by creating a brand new page with no inbound links. Then visit that page using browsers with google toolbar installed.