mayor - 4:41 pm on Dec 28, 2002 (gmt 0)

Here's the way I understand the robot directives to work:

This is a general wildcard directive for all bots (an exclusion directive in this example):

User agent: *
Disallow: /

But a specific directive can override the general one, just for the specified bot, while all non-specified bots remain subject to the general directive. So this record would override the above general exclusion and specifically allow (ie not exclude) scooter while all other bots remain excluded:

User-agent: scooter
Disallow:

Both records would have to appear in the file for this explanation to hold.