homepage Welcome to WebmasterWorld Guest from 54.235.39.132
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Submitting child sitemaps too alongwith sitemap index file ?
sitemap issue for mammoth sites
OMZen




msg:4186360
 6:52 am on Aug 13, 2010 (gmt 0)

We have a rather large site, with 100 million plus records in DB

Iíve created sitemap index file with child sitemaps that confirm to the sitemaps.org protocol.

All the child sitemaps are uploaded to the server and I have submitted the sitemap index file to Google via Google Webmaster Central ( GWC ) account.

My questions are:

1)
In addition to submitting the sitemap index file to Google Webmaster Central, do I need to submit the child site maps too individually?

2)
We have mod rewrite in place and all urlís are search engine friendly along with unique title tags.

Link building activity is underway to increase the link juice at root as well as category level pages.

Is there anything else that can be done to get the maximum number of pages crawled & indexed ?

Any guidance would be highly appreciated. TIA.
-AD

 

goodroi




msg:4186438
 11:15 am on Aug 13, 2010 (gmt 0)

#1 - You dont have to submit the sub sitemaps but i would since it takes 5 seconds.

#2 - To boost your page crawling:
a) Do more link development, there is never enough
b) Make sure your pages have great internal links, turn your site into a spider web
c) Boost traffic on your site, google toolbar users can impact your crawling. Some people use PPC to achieve this.
d) Make sure you have SIGNIFICANT & UNIQUE content for every page.

OMZen




msg:4186466
 12:13 pm on Aug 13, 2010 (gmt 0)

Thanks goodroi for your input - I will submit child sitemaps too then.

Your comment about traffic data affecting crawling is rather interesting. I don't recollect coming across any credible references to that effect but nevertheless, it makes sense.

-AD

goodroi




msg:4186901
 2:45 am on Aug 14, 2010 (gmt 0)

Dont take my word for it. Test it yourself by creating a brand new page with no inbound links. Then visit that page using browsers with google toolbar installed.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved