1script - 8:02 pm on Apr 1, 2010 (gmt 0)

@tantalus:

Dude, that's the first time I hear that you need to explicitly allow anything in robots.txt

After all, it a Robots exclusion standard! I think you are digging in a wrong direction.

Cheers!