Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
----  HTTP Page robots.txt not found 404 error
davidpbrown - 12:34 pm on Dec 5, 2003 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/210.htm
robots.txt is a standard way that search engines determine areas of your site to search.
for more see..
Brought to you by WebmasterWorld: http://www.webmasterworld.com