Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Placing Sitemaps in Robots.txt

Do I put all 3?



6:52 pm on Jul 9, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I have a site that has three sitemap files to cover the entire site.


Is it best to just add the first one to my robots.txt or all three:

sitemap: http://www.example.com/sitemap.xml
sitemap: http://www.example.com/sitemap1.xml
sitemap: http://www.example.com/sitemap2.xml


1:57 pm on Jul 12, 2010 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

why not use a sitemap index file? that would group your multiple sitemap files into one line on your robots.txt.


3:26 pm on Jul 12, 2010 (gmt 0)

I wrote a script to generate sitemaps and just realised that the sitemap index is a great solution for my script, avoids manual editing of robots.txt

Now, to see whether it really helps with indexing


7:20 pm on Jul 12, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

http://www.example.com/sitemap.xml is the index file (it lists only the sitemap*.xml files with my site urls).

So I will just add to the robots.txt:
sitemap: http://www.example.com/sitemap.xml


Featured Threads

Hot Threads This Week

Hot Threads This Month