Quick question on robots.txt

Can you separate the agent and the allows/disallows?

[cmendla]

Help, the googlebot is clobbering my phpbb boards. It's been running rampant for about 5 days.

I'm trying to keep it out of everything but the messages and forum topics.

Question.

Does it matter if there are blank lines or remarks between the user agent line and the allows/disallows?

In other words would the following work?

User-agent: *
Disallow: /discussions/admin/

# this is a remark so I remember why i added the line below
Disallow: /discussions/db/

or would I have to add the User-Agent: * under the # remark

Thanks...
c

[Dijkgraaf]

Use the Robot Validator (see link on this forums main page). You example does validate.

No, it is not correct to list the same user-agent multiple times. This could cause unexpected results with some bots.