Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
tangor - 7:29 pm on Oct 30, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4619880.htm
In all cases, it will (eventually) come down to page access speed... as some of these new buggers download images, too... and why not? Given system abilities these days all is possible.
But bots work on "how many per hour" and that's a giveaway.
Brought to you by WebmasterWorld: http://www.webmasterworld.com