- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- google and robots.txt - do I need one?
Brett_Tabke - 3:43 am on Aug 7, 2002 (gmt 0)
No, the Robots Exclusion Standard is to (you guessed it) exclude robots - not include. Welcome to the board.
Thread source: http://www.webmasterworld.com/robots_txt/58.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com