Am I correctly blocking diamondbot?

Forum Moderators: goodroi

Message Too Old, No Replies

4:58 am on Sep 11, 2005 (gmt 0)

Am I correctly blocking diamondbot? Please tell me if I'm doing anything wrong.

[quote]User-agent: *
Disallow: /bob/
Disallow:

User-agent: DiamondBot
Disallow: *[quote]

11:25 am on Sep 11, 2005 (gmt 0)

Wildcards (*) in Disallow field are not part of robots.txt standard, if you want to disallow ALL URLs then use /, ie:

User-agent: *
Disallow: /bob/
Disallow:
User-agent: DiamondBot
Disallow: /