- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Do we need robots.txt?
hurlimann - 9:58 pm on Jun 5, 2002 (gmt 0)
No. The file is only important if you want to tell the spiders and others to do something not normal.
Thread source: http://www.webmasterworld.com/robots_txt/112.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com