Pfui - 8:54 am on Oct 28, 2010 (gmt 0)
I'm not sure how strictly other forums here handle the link guidelines. In this one, I've found that links to very specific observations, like those two sites with details and a screenshot, tend to pass muster. (As opposed to more personal diary-like blog musings.) And particularly when there's precious little info elsewhere.
So about Google's new, cloaked bot running from bare Googlebot IPs -- how did it behave, please?
- Did it read/heed robots.txt? Or did it appear to 'share' prior Googlebot robots.txt hits?
- Did it hit all kinds of files, launch JS, etc.? (If you have numerous filetypes allowed in robots.txt. I don't.)
- Did it crawl in typical a Googlebot pattern/rate?
TIA for more Tales from the Server-Side:)