Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Proposal for robots.txt To Have Greater Flexibility


Rosalind - 3:46 pm on Nov 30, 2007 (gmt 0)


The new ACAP commands will use the same robots.txt file that search engines now recognize.

Shouldn't they use a different one, say acap.txt? Only I can see this possibly breaking a lot of robots.txt files because once you start to add complexity, errors always creep in.

Other than that, I think it's a positive move for webmasters who want more control, provided there are enough options.


Thread source:: http://www.webmasterworld.com/robots_txt/3516185.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com