homepage Welcome to WebmasterWorld Guest from 23.22.173.58
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
same old same old YisouSpider
Yisou back from the dead?
lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4568771 posted 11:44 pm on Apr 28, 2013 (gmt 0)

I thought this was a brand-new spider. Turns out it's so old I've never met it before; Forums search turns up a fistful of posts, none with numbers above three or four digits. Back around 2005 everyone seemed to be flagging it as a new Chinese search engine.

:: insert irrelevant allusion here to "Brazil is the country of the future-- and always will be" ::

Here they are snuffling around my test site.

110.75.172.109 - - [24/Apr/2013:12:39:58 -0700] "GET / HTTP/1.1" 301 557 "-" "YisouSpider"
110.75.172.109 - - [24/Apr/2013:12:39:59 -0700] "GET / HTTP/1.1" 200 910 "-" "YisouSpider"


Apparently they're a tentacle of Yahoo! Slurp; the IP bears this out.

As long as I was there, I mopped up all the Chinese /15 and /16 within the 110 sector. I don't go below /14 unless something draws my attention to the range. Robotic activity definitely qualifies.

No, I don't know why I don't have a global block on UAs containing the element "spider". But I'm sure there's a reason.

 

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4568771 posted 7:49 pm on Apr 30, 2013 (gmt 0)

I hadn't listed that, either. :( Thanks.

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4568771 posted 8:48 pm on Sep 5, 2013 (gmt 0)

:: bump ::

Met it again at
42.156.139.110
There's a snippet of Malaysia nearby at
42.156.32.0/22
but everything else is China as far as the eye can see, so I went ahead and blocked as
42.156.0.0/14

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4568771 posted 1:23 am on Sep 6, 2013 (gmt 0)


I also have as Alisoft, China

42.120.0.0 - 42.121.255.255
42.120.0.0/15

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved