Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- And Now Google's Doing It. JS Stats Show GoogleBot


lucy24 - 12:51 am on May 15, 2011 (gmt 0)


IDK how they decide which page to fetch or when and I really don't want to take the time to research it and find out

I, on the other hand, desperately need to procrastinate working on Volume V of the eleven-volume German translation of Macaulay's History of England. Unfortunately, this is really true.

Look at the logs for the site named in your user profile, about four minutes before the time of this post. Do you see a whole slew of hits from Google Web Preview, followed by a single visit from a UA containing the word "Camino"?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4312058.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com