homepage Welcome to WebmasterWorld Guest from 50.17.66.61
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Placing Sitemaps in Robots.txt
Do I put all 3?
jdancing

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4167337 posted 6:52 pm on Jul 9, 2010 (gmt 0)

I have a site that has three sitemap files to cover the entire site.

http://www.example.com/sitemap.xml
http://www.example.com/sitemap1.xml
http://www.example.com/sitemap2.xml

Is it best to just add the first one to my robots.txt or all three:

sitemap: http://www.example.com/sitemap.xml
sitemap: http://www.example.com/sitemap1.xml
sitemap: http://www.example.com/sitemap2.xml

 

goodroi

WebmasterWorld Administrator goodroi us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4167337 posted 1:57 pm on Jul 12, 2010 (gmt 0)

why not use a sitemap index file? that would group your multiple sitemap files into one line on your robots.txt.

karter

10+ Year Member



 
Msg#: 4167337 posted 3:26 pm on Jul 12, 2010 (gmt 0)

I wrote a script to generate sitemaps and just realised that the sitemap index is a great solution for my script, avoids manual editing of robots.txt

Now, to see whether it really helps with indexing

jdancing

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 4167337 posted 7:20 pm on Jul 12, 2010 (gmt 0)

http://www.example.com/sitemap.xml is the index file (it lists only the sitemap*.xml files with my site urls).

So I will just add to the robots.txt:
sitemap: http://www.example.com/sitemap.xml

Thanks

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved