Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- very unusual swarm of crawlers


wilderness - 11:29 am on Mar 12, 2012 (gmt 0)


These requests pretty much stopped within a few days, however some three weeks later and odd-guy-out follows (and from our Dear friends at Amazon)

46.137.130.60 - - [12/Mar/2012:09:22:13 +0000] "GET /SameFolder/SamePartialPagename HTTP/1.1" 403 533 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; rv:1.7.3) Gecko/20041001 Firefox/0.10.1"

FF 0.10.1 must be a new version ;)


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4421994.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com