tigertom - 7:07 pm on Jan 17, 2007 (gmt 0)

I had changed it to the directive order below, and the Bad Slurp Bot still accessed the disallowed sub-directory. As I said, it seems to have stopped now, but is the following correct?:

User-agent: *
Disallow: /shop/
Disallow: /forum/
Disallow: /cgi-bin/
Disallow: /badbottrap/

User-agent: Slurp
Disallow: /bloop/
Disallow: /blop/

i.e. will all bots avoid the bottrap directory, and Slurp also avoid the specified ones, if they're obedient little bots?