pageoneresults - 5:56 pm on May 19, 2003 (gmt 0)

I'd be somewhat hesitant using the Allow directive as I don't think it is supported across the board. Also, the robots.txt file validators that I've checked return this error when including the Allow directive...

Invalid fieldname. There is no Allow.

There has been some discussion on this for quite some time amongst those who govern the robots.txt protocol. As far as I know, it has not been implemented yet.

The default behavior of the robots.txt file is to allow all unless of course you have a Disallow for that resource.

User-agent: Googlebot
Disallow: /

P.S. Hehehe, I've only had to use that directive once! ;)