homepage Welcome to WebmasterWorld Guest from 54.197.110.151
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
HiChina
keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4519866 posted 8:47 am on Nov 17, 2012 (gmt 0)

UA: Mozilla/5.0 (Windows NT 6.1; rv:9.0) Gecko/20100101 Firefox/9.0
robots.txt: no

Busted due to same-page referrer.

HiChina, Hosting
112.124.0.0 - 112.127.255.255
112.124.0.0/14

 

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4519866 posted 10:55 am on Nov 17, 2012 (gmt 0)

Heh. I've got the brutal version:
112.122.0.0/15 China
112.124.0.0/14 China
112.128.0.0/14 China
112.132 China

Busted due to same-page referrer.

That's one of those php-script things isn't it? Every time I think I've worked it out in mod_rewrite I discover that I've got my lefts and rights mixed up again :( So I can only flag auto-referers after the fact and slap on a quick Robot label.

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4519866 posted 7:48 pm on Nov 17, 2012 (gmt 0)

HiChina is a hosting company. The other ranges you listed are ISPs.

While many nasty things often come from those ISPs, personally I have taken down regional blocks to China and now treat them like any other country, e.g. just block hosts & those ranges proven to be a PITA. I've plugged a couple holes (w/ those php-script things, etc) so most of the bad guys don't get through anyway.

Bewenched

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 4519866 posted 1:50 am on Nov 18, 2012 (gmt 0)

Keyplr,
Can you share you blocking technique for those "those php-script things" :)

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4519866 posted 3:37 am on Nov 18, 2012 (gmt 0)


Just do a Bing search. You should be able to come up with something.

Bad tactics to post defensive strategy in an open forum, plus I don't need the liability.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved