Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Add XMLsitemap link to robots.txt

         

skinnyalley

7:26 am on Oct 31, 2007 (gmt 0)

10+ Year Member



Recently I have come across that adding the sitemap.xml link ie www.example.com/sitemap.xml in your robots.txt file would be very beneficial.

It seems that this change will help make the XML sitemaps protocol a widely used standard. The primary reason being it enables Google to automatically discover XML sitemaps on their own.Is it really helpful

tedster

8:02 am on Oct 31, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It is part of the evolving protocol, and supported by several of the major search engines.

Specifying the Sitemap location in your robots.txt file

You can specify the location of the Sitemap using a robots.txt file. To do this, simply add the following line:
Sitemap: <sitemap_location>

The <sitemap_location> should be the complete URL to the Sitemap, such as: http://www.example.com/sitemap.xml

This directive is independent of the user-agent line, so it doesn't matter where you place it in your file. If you have a Sitemap index file, you can include the location of just that file. You don't need to list each individual Sitemap listed in the index file.

[sitemaps.org...]

I can't say whether it "helps" or not. That depends on what kind of trouble you're trying to fix, I suppose.