homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Placing Sitemaps in Robots.txt
Do I put all 3?

 6:52 pm on Jul 9, 2010 (gmt 0)

I have a site that has three sitemap files to cover the entire site.


Is it best to just add the first one to my robots.txt or all three:

sitemap: http://www.example.com/sitemap.xml
sitemap: http://www.example.com/sitemap1.xml
sitemap: http://www.example.com/sitemap2.xml



 1:57 pm on Jul 12, 2010 (gmt 0)

why not use a sitemap index file? that would group your multiple sitemap files into one line on your robots.txt.


 3:26 pm on Jul 12, 2010 (gmt 0)

I wrote a script to generate sitemaps and just realised that the sitemap index is a great solution for my script, avoids manual editing of robots.txt

Now, to see whether it really helps with indexing


 7:20 pm on Jul 12, 2010 (gmt 0)

http://www.example.com/sitemap.xml is the index file (it lists only the sitemap*.xml files with my site urls).

So I will just add to the robots.txt:
sitemap: http://www.example.com/sitemap.xml


Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved