Forum Moderators: open

Message Too Old, No Replies

Sosospider

Another Rude Spider

         

Ocean10000

5:01 pm on Aug 16, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



User-Agent
Sosospider+(+http://help.soso.com/webspider.htm)

Supplies
Referrer: Yes
Accept Header: Yes
Compression: Gzip
Accepted Languages: zh-cn,zh-hk,zh-tw,en-us

Checks Robots.txt: Yes
Ignores Robots.txt: Yes

First Sighting on : 5-17-2008

Seen in the following Ranges
124.115.0.*
124.115.4.*
58.61.164.*

It Does Supply Referrer information but I have only seen the referrers being my own homepage which it can not get due to being blocked.

It has also the ability to spoof the following User-Agent sometimes first before checking the Robots.txt or trying with its Spider User-Agent.
Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1)

GaryK

7:43 pm on Aug 16, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



As I mentioned to Owen, there's another bot associated with this one that I first saw back in late 2008:

Sosoimagespider ( [help.soso.com...]

ROBOTS.TXT? No

It took favicon.ico from a bunch of sites and left. It's made just six more visits since then. I don't have any info on what it took during those visits.

dstiles

8:22 pm on Aug 16, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Over 3000 hits this month for sosospider across a server of mainly small-time UK sites. All blocked 403. It's been coming around for ages.

Depending on associated headers the MSIE UA is also frequently blocked.