Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots text to block all but index page of a forum


Pjman - 10:41 pm on Dec 21, 2011 (gmt 0)


I'm trying to generate an robot text file to disallow all SEs on all pages of forum except the index page.

So I want to allow it to index:

mysite.com/forum/


But anything else in the forum directory and subdirectories, I don't want indexed.

mysite.com/forum/$anythingelse$

I remember a command with a question mark in it that worked in the past. But I can't find any guidance on that.


Does anyone know how to do that?


Thread source:: http://www.webmasterworld.com/robots_txt/4400312.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com