Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- More Chinanet


not2easy - 8:35 pm on Nov 23, 2012 (gmt 0)


A few of the sites I run do not do any business outside the US, but these look like huge chunks to add in htaccess files, so I am trying to stick to IPs that are actually being abusive. I don't get to use httpd. I am blocking by CIDR, but cringe at the number of lines it takes.

Long ago I blocked myself with generous blocking so I do check "iffy" ranges, that is good advice.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4521839.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com