Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Do we need robots.txt?
Beachboy - 9:57 pm on Jun 5, 2002 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/112.htm
Not unless you need to issue a specific directive to a spider, usually having to do with excluding certain areas of the site from spidering. If not, then don't worry.
Brought to you by WebmasterWorld: http://www.webmasterworld.com