Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Google Web Preview
motorhaven - 4:22 am on Jul 29, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4478563.htm
Quick follow-up. I did a scan of the last 30 days for 4.x.x.x IPs. Countless legit hits, just a handful of hits getting snagged by my traps, and they appear at first glance to be exploited PCs, not server farms/crawlers.
Brought to you by WebmasterWorld: http://www.webmasterworld.com