Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots.txt - Working or not ?


g1smd - 7:42 pm on Jan 7, 2009 (gmt 0)


I documented a load of Duplicate Content issues with forums back in 2004 or 2005 or so. I think I might have also included some example robots.txt files to help counteract some of the problems.


Thread source:: http://www.webmasterworld.com/robots_txt/3820958.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com