Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Proactive vs. Reactive IP Range Blocking


incrediBILL - 6:35 am on Nov 8, 2012 (gmt 0)


Just curious whether most bot blockers in the spider forum block all data centers just as a matter of policy or do you wait until something happens before quarantining an IP range?

Furthermore, do some of you literally hunt down data center IP ranges just to make sure you have them all?

I'm kind of 50/50 myself as I'll try to make sure I have all known ranges for places well known for bad traffic like AWS, The Planet, etc. but I don't look too hard for companies that run a pretty clean shop like Peer 1, RackSpace, etc. Therefore I'm proactive where I know there's trouble and more reactive in other places and address them only as they come along.

Doesn't mean I still don't have thousands of IP ranges being blocked, but I'm sure many of you have many more!


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4517026.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com