Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Add Sitemap To robots.txt For Autodiscovery

keyplyr - 7:19 am on Apr 13, 2007 (gmt 0)


Adding "Sitemap: http://www.example.tld/sitemap.xml" invalidates robots.txt in each of the 3 validators I tried, as well as Google Webmaster Tools' robots.txt analysis (as mentioned above by Bewenched.)

I think I'll wait until everyone catches up to the new standard.

Thread source:: http://www.webmasterworld.com/robots_txt/3310622.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com