Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Add Sitemap To robots.txt For Autodiscovery

Ask.com, Google, Microsoft Live Search and Yahoo!

8:59 am on Apr 12, 2007 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 2, 2005
votes: 0

Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly.

All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: http://www.example.tld/sitemap.xml

More [ysearchblog.com...]

[edited by: engine at 11:41 am (utc) on April 12, 2007]

9:45 pm on Apr 17, 2007 (gmt 0)

Full Member

10+ Year Member

joined:Dec 3, 2006
votes: 0

The error message has disappeared from my tools. They must have changed something today.

I also see a new tool: "URL Removals"

[edited by: Achernar at 9:46 pm (utc) on April 17, 2007]


7:56 am on May 4, 2007 (gmt 0)



The following message was cut out to new thread by goodroi. New thread at: robots_txt/3330636.htm [webmasterworld.com]
7:31 am on May 4, 2007 (utc -5)
This 32 message thread spans 2 pages: 32

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members