-- Search Engine Spider and User Agent Identification
---- "DAPPER-HOST-IP" why Baidu ?
lucy24 - 8:36 pm on Sep 28, 2013 (gmt 0)
I try to be fair about China (Ukraine, Russia, Korea, etc). I mark them as potential trouble and block them from accessing some UK-only web sites. On others I let them through. If an IP causes trouble it gets temporarily blocked.
I have some parts of the world on a "one-strike" rule. If I meet a bad robot from anywhere that turns out to be from Eastern Europe (in practice = Poland + former Soviet, greater leeway for Baltic) the range is generally blocked. Someone hereabouts said that IP addresses in this geographical area tend to be mixed human ISPs and servers, so you can't readily classify them as one or the other. The same may well apply to parts of southeast Asia, but I haven't met enough of them to bother with.
Don't know if other people's experience is similar. But robots from Brazil or Vietnam or whatnot tend to be one-offs, while a Ukrainian robot once established will keep hammering away forever.
18.104.22.168/16 I have as VPLS.net a reseller biz hosting service, with the mothership being Krypt Technologies
Well, if you want to spend time searching the corpses for ID, it's your lookout ;)