- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- How to make a page *inaccessible* to searches
bcolflesh - 5:23 pm on Nov 5, 2003 (gmt 0)
That'll stop all bots who obey/read the robots.txt file - don't count on this method - don't put data in a public place that you don't want to be "found".
Thread source: http://www.webmasterworld.com/robots_txt/187.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com