johnxarce
msg:3630843 | 10:14 am on Apr 20, 2008 (gmt 0) |
this is my first i saw robots.txt like this
User-agent: *
Disallow: /*/edit.html
Disallow: /*/report.html may you can try to use this in normal format
|
goodroi
msg:3630904 | 1:47 pm on Apr 20, 2008 (gmt 0) |
what you are using is called wildcards or pattern matching. and basically it is telling the search engines not to index and file that has that sequence of character in it. the big search engines support this. it is not technically valid. the robots.txt protocol does not support wildcards (pattern matching). this means that the other bots will not probably be able to support this.
|
|
