Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- google and robots.txt - do I need one?
Brett_Tabke - 3:43 am on Aug 7, 2002 (gmt 0)
No, the Robots Exclusion Standard is to (you guessed it) exclude robots - not include. Welcome to the board.
Thread source:: http://www.webmasterworld.com/robots_txt/58.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com