Will Googlebot (and other user agents that start with the string "google") follow the instructions following that line? Is it case sensetive or not?
daveozzz
8:20 am on May 9, 2007 (gmt 0)
This doesn't answer your question entirely but to be safe perhaps follow the instructions on Google Blog [google.com]
goodroi
12:34 pm on May 9, 2007 (gmt 0)
It is not valid. It might work, it might not but it is not valid. If you want to be sure Google will do what you want you need to follow Google's instructions.