Yidaki - 8:25 pm on Mar 16, 2004 (gmt 0)

>see if it ever grabbed the robots.txt file.

It didn't at my place.

Found something from the horse's mouth:

I hadn't heard of GoogleBot/Test, but I'll ask about the 406 issue. I wouldn't be surprised to see different Googlebots with slightly different code in some ways--we're always trying new things. ScottM, I'd say it's best to prepare to recognize Googlebot by looking for either the old or the new user agent.

GoogleGuy msg#: 44 - Mar 7, 2004
[webmasterworld.com...]

So this means ...?

[edited by: Yidaki at 8:32 pm (utc) on Mar. 16, 2004]