---- Google is spidering everything, including blocked pages
StoutFiles - 3:21 pm on Dec 30, 2011 (gmt 0)
Preview isn't a robot. You and I may think it is, but g### has decided otherwise. After a few weeks of "Which part of 'Disallow: /piwik' did you not understand?" I caved in and went to a more robust
Can we confirm that blocking the Preview bot won't hurt search rankings now, or in the future? If I was Google, I wouldn't want to build a Preview tool and then have a slew of sites on the first page not support it, it makes Google look bad. Just something to consider.