Page is a not externally linkable
tedster - 12:05 am on Aug 16, 2006 (gmt 0)
I tend to trust his experience on this one.
Up above, GoogleGuy said "I believe most/all search engines interpret robots.txt this way--a more specific directive takes precedence over a weaker one."