Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Do I need a robots.txt file for Googlebot to read?
Marcia - 2:40 am on Jun 17, 2002 (gmt 0)
It's worth repeating - even having a blank page named robots.txt will avoid a lot of 404s.
Thread source:: http://www.webmasterworld.com/robots_txt/113.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com