- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- I've been looking at the WW robots.txt ...
sun818 - 6:22 am on Jan 31, 2004 (gmt 0)
> Security and liability risks.
Can you explain? Are we talking about deleted posts that may be archived, etc?
Thread source: http://www.webmasterworld.com/robots_txt/255.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com