Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Filtering Out Really Hard To Find Bad Bots


not2easy - 10:15 pm on Jan 19, 2013 (gmt 0)


It is easy enough to block and individual IP or a malformed UA that you find doing things you don't want them to do but what do you do with IPs inside AT&T or Verizon that use a common vanilla agent? I am blocking individual IPs, I just don't think that is a very reliable defense when I see my own IP change daily and even in the same day. Do most Communications ISP clients have unique static IPs?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4536448.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com