-- Search Engine Spider and User Agent Identification
---- MSNBot has become a constant Fast-Scraper
AlexK - 3:11 pm on Dec 25, 2011 (gmt 0)
the odd Google IP & Yahoo! IP has occasionally got caught up in this net
What good timing!
2011-12-25 04:59:01 :: 18.104.22.168 [forums.modem-help.co.uk] :: max 3 / sec
The above is a GoogleBot; the IP is on ASN AS15169 [cidr-report.org] (GOOGLE). To keep this report balanced, it does seem that Google respond quickly to the abuse reports (though not to me), as their bots seldom re-offend. However, and also in the name of balance, Google is the only search-engine to currently feature within the Top-50 Bad Hosts maintained by HostExploit [hostexploit.com] (Q3 2011 [hostexploit.com] position is #30) (Yahoo! were #33 in Q1 2011, but have since dropped off the listing).