Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Add Sitemap To robots.txt For Autodiscovery

Ask.com, Google, Microsoft Live Search and Yahoo!



8:59 am on Apr 12, 2007 (gmt 0)

5+ Year Member

Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly.

All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: http://www.example.tld/sitemap.xml

More [ysearchblog.com...]

[edited by: engine at 11:41 am (utc) on April 12, 2007]


9:45 pm on Apr 17, 2007 (gmt 0)

5+ Year Member

The error message has disappeared from my tools. They must have changed something today.

I also see a new tool: "URL Removals"

[edited by: Achernar at 9:46 pm (utc) on April 17, 2007]


7:56 am on May 4, 2007 (gmt 0)


The following message was cut out to new thread by goodroi. New thread at: robots_txt/3330636.htm [webmasterworld.com]
7:31 am on May 4, 2007 (utc -5)
This 32 message thread spans 2 pages: 32

Featured Threads

Hot Threads This Week

Hot Threads This Month