Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- how to block indexing of root domain, but still allow sub-domain
goodroi - 12:50 pm on Oct 16, 2008 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/3765552.htm
If you are already redirecting all the blog urls into the forum index page then you do not need to worry about blocking the pages. It will just take some time for the spiders to revisit your site and update their index.
Brought to you by WebmasterWorld: http://www.webmasterworld.com