- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Robots.txt question
charon - 9:14 am on Aug 19, 2002 (gmt 0)
Thanks all, this is useful stuff. I guess what I really need to know is do any of the major engines ignore it? But I'll search around the other forums as recommended.
Thread source: http://www.webmasterworld.com/robots_txt/94.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com