lucy24 - 5:34 am on Apr 10, 2013 (gmt 0)
UA contains crawler
It would have got an automatic "robot" flag in log wrangling if it hadn't already caught my attention by the excess of 404s and huge number of page requests. Yes, I did detour to htaccess: "Huh? Don't I block those?" I have to do some more checking, because when I don't block something that obvious, it probably means there's a solid reason but I can't remember it at the moment :(
otoh I did just throw in the towel and lock out that new snippetbot after I caught it snuffling around my test site. Far as I can make out, that business on the www page about g+ users posting links is a complete fabrication; all it ever gets is the front page and favicon.
except robots.txt and my 403 file
With me it's robots.txt, assorted boilerplate, and the stylesheet that goes with error documents. Makes it easier to tell if I've accidentally locked out a human.