Forum Moderators: goodroi
The category I want to be indexed and cached is:
[mydomain.com...]
The category I do not want to be indexed and cached is:
[mydomain.com...]
so will:
User-Agent: *
Disallow: /mydirectory.asp?cat=TheOneNotToBeCached
work for me? if not, what will?
Disallow: /mydirectory.asp?cat=TheOneNotToBeCached
vs
[mydomain.com...]
Generally speaking robots.txt does not support parameters and therefor it might not work, though Google for example accepts wildcards in robots.txt files
thanks for your reply.
The URLs I want to ban are:
[mydomain.com...]