jmccormac - 5:02 pm on Oct 30, 2013 (gmt 0)
A lot of existing high volume scrapers tend to be distinguishable from human users in the way that they don't download graphics or have a randomised downloading sequence. Perhaps it is more a site specific issue in that the kind of data and the requirements of the scraper vary?
@wilderness A precient or accidental waste of time. Hundreds of millions of IPs and so many data centres. :)