lucy24 - 4:37 am on Mar 27, 2012 (gmt 0)
If g### doesn't like what it sees in robots.txt why doesn't it just ignore it? Preview, Translate, Goggles and Wireless Transcoder already do. So does the plainclothes msnbot and everything from Yahoo.
I've got certain well-known robots blocked from piwik.js via htaccess because they refuse to honor instructions to keep the ### out. What do they think-- that instead of a well-known analytics program, I've got a secret stash of extra formatting in there?