Forum Moderators: mack
------------------------
User-agent: *
Disallow: /folder1/web/
------------------------
In folder /folder1/web/ I have many files that i want to exclude with the exception of one file inc.html (which it would be too difficult to change of folder)
My question is does Robots text support and Disallow/allow file option?
That is, can it work something like this:
------------------------
User-agent: *
Disallow: /folder1/web/
Allow: /folder1/web/inc.html
------------------------
No, there is no allow option that I am aware of. This is a real good robots txt tutorial [searchengineworld.com]