1script - 4:09 pm on Sep 27, 2012 (gmt 0)

Found another peculiarity about these Index reports: one of my sites has Ever Crawled *lower* than the sum of Indexed and Not Selected. How's that even possible?

If I add "Blocked by robots[.txt]", I am now having "Ever Crawled" 1.5 times less than the sum of the other types. And I thought "Ever crawled" should be definition be more than the sum of the other types.

So, is this an evidence of Google truly inventing non-existing URLs (perhaps based on query strings) or is this just a technical counting error?

Is it possible that pages crawled by other means (image bot, adsense bot) are added to the index but don't make it into the "Ever crawled" figure, which could be based on traditional Googlebot visits only (just a conjecture)? It would be a silly omission of course but Google engineers are also people, have to keep that in mind :)