Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- GoogleProducer


Pfui - 5:16 pm on Dec 11, 2011 (gmt 0)


So it appears this Producer bot is making snapshots, among other things.


Do the snapshots resemble Google Web Preview's?

Seeing as how G's using the same bare/no rDNS IPs for both bots (& others), it'd make sense they recycle their, or rather our, thumbnails.

Interestingly, and perhaps ominously, when I add up all G-spawned bot traffic I see in any 24-hour period, the vast majority of hits are no longer from googlebot.com, using Googlebot, reading/heeding robots.txt.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4395847.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com