tangor - 5:43 pm on Apr 11, 2010 (gmt 0)

Edge... it's been my experience if google is allowed in they assume all the rest of their little bots are allowed, too... hence if you DON'T want Googlebot-Mobile (example) you'd have to disallow that one.

I generally whitelist (allow) a handful of useful bots and disallow all others. Makes for a much shorter robots.txt !