- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Google - robots.txt - indexing
Woz - 9:40 am on Jun 24, 2002 (gmt 0)
funny, first time I clicked on the link in the first post it came up showing zero responses. Then, on second attempt, it came up. Perhaps still quivering after the aborted update.
Thread source: http://www.webmasterworld.com/robots_txt/34.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com