Welcome to WebmasterWorld Guest from 184.73.122.162

Forum Moderators: goodroi

Message Too Old, No Replies

Placing Sitemaps in Robots.txt

Do I put all 3?

     
6:52 pm on Jul 9, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 18, 2003
posts: 745
votes: 0


I have a site that has three sitemap files to cover the entire site.

http://www.example.com/sitemap.xml
http://www.example.com/sitemap1.xml
http://www.example.com/sitemap2.xml

Is it best to just add the first one to my robots.txt or all three:

sitemap: http://www.example.com/sitemap.xml
sitemap: http://www.example.com/sitemap1.xml
sitemap: http://www.example.com/sitemap2.xml
1:57 pm on July 12, 2010 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
posts:3154
votes: 129


why not use a sitemap index file? that would group your multiple sitemap files into one line on your robots.txt.

karter

3:26 pm on July 12, 2010 (gmt 0)

Inactive Member
Account Expired

 
 


I wrote a script to generate sitemaps and just realised that the sitemap index is a great solution for my script, avoids manual editing of robots.txt

Now, to see whether it really helps with indexing
7:20 pm on July 12, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 18, 2003
posts:745
votes: 0


http://www.example.com/sitemap.xml is the index file (it lists only the sitemap*.xml files with my site urls).

So I will just add to the robots.txt:
sitemap: http://www.example.com/sitemap.xml

Thanks