homepage Welcome to WebmasterWorld Guest from 54.211.235.255
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

This 32 message thread spans 2 pages: < < 32 ( 1 [2]     
Add Sitemap To robots.txt For Autodiscovery
Ask.com, Google, Microsoft Live Search and Yahoo!
OldWolf




msg:3309158
 8:59 am on Apr 12, 2007 (gmt 0)

Since working with Google and Microsoft to support a single format for submission with Sitemaps, we have continued to discuss further enhancements to make it easy for webmasters to get their content to all search engines quickly.

All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: http://www.example.tld/sitemap.xml


More [ysearchblog.com...]

[edited by: engine at 11:41 am (utc) on April 12, 2007]

 

Achernar




msg:3313970
 9:45 pm on Apr 17, 2007 (gmt 0)

The error message has disappeared from my tools. They must have changed something today.

Edit:
I also see a new tool: "URL Removals"

[edited by: Achernar at 9:46 pm (utc) on April 17, 2007]

System
redhat



msg:3330638
 7:56 am on May 4, 2007 (gmt 0)

The following message was cut out to new thread by goodroi. New thread at: robots_txt/3330636.htm [webmasterworld.com]
7:31 am on May 4, 2007 (utc -5)

This 32 message thread spans 2 pages: < < 32 ( 1 [2]
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved