Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt exclusion question


olof_bailey - 8:48 am on Sep 10, 2003 (gmt 0)


Right basically I want to exclude an entire site except for one directory (a forum). The problem is that this forum directory resides in the root of the site (with all of the active pages I need to exclude)

Probably a silly question but is there any way of doing this without excluding all of the files individually?

Cheers Guys

Rich


Thread source:: http://www.webmasterworld.com/robots_txt/4.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com