- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Do we need robots.txt?
Beachboy - 9:57 pm on Jun 5, 2002 (gmt 0)
Not unless you need to issue a specific directive to a spider, usually having to do with excluding certain areas of the site from spidering. If not, then don't worry.
Thread source: http://www.webmasterworld.com/robots_txt/112.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com