Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- blocking dynamic parts of forum


incrediBILL - 4:58 am on Apr 25, 2011 (gmt 0)


It's better IMO to use the meta ROBOTS NOINDEX for those pages because only Google non-standard robots.txt enhancements is flexible enough to what you want leaving the other SEs still to be dealt with.


Thread source:: http://www.webmasterworld.com/robots_txt/4303490.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com