-- Search Engine Spider and User Agent Identification
---- MSNBot has become a constant Fast-Scraper
AlexK - 2:24 pm on Dec 30, 2011 (gmt 0)
@g1smd: That is why the routines look for extended fast-scraping across a period of seconds before blocking. (let me check the algorithm) ...on my forums, if you open more than 14 pages across 7 seconds you get blocked.