I'm trying to generate an robot text file to disallow all SEs on all pages of forum except the index page.
So I want to allow it to index:
mysite.com/forum/
But anything else in the forum directory and subdirectories, I don't want indexed.
mysite.com/forum/$anythingelse$
I remember a command with a question mark in it that worked in the past. But I can't find any guidance on that.
Does anyone know how to do that?