Page is a not externally linkable
- Marketing and Biz Dev
-- Deprecated - Search Engine Submission
---- how to prevent directory from being indexed?

dan_popescu - 9:57 pm on Dec 2, 2002 (gmt 0)


I just made a robots.txt file for my site. I've included a few files that I don't want indexed. How do I include an entire directory in robots.txt? I know the syntax for files is "disallow: file.htm". Is the syntax for an entire directory (and its content) the same: "disallow: directory"?

Thanks
Dan

Thread source:: http://www.webmasterworld.com/submission/464.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com