Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots text to block all but index page of a forum
tangor - 11:41 am on Dec 22, 2011 (gmt 0)
Allow forum/index.html
Disallow forum/
Works for me in real life.
mysite.com/ is not required
Order is important.
Thread source:: http://www.webmasterworld.com/robots_txt/4400312.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com