Forum Moderators: DixonJones

Message Too Old, No Replies

SBIder

Does this benefit me in any way?

         

zCat

4:30 pm on Apr 26, 2006 (gmt 0)

10+ Year Member



I've been seeing hits from this:

SBIder/0.8-dev (SBIder; [sitesell.com...] [support.sitesell.com...]

The spider page says it's Nutch based and respects robots.txt; as to what it does, they say

SiteSell is gathering a statistical representation of topics presented on the Web as a whole. Each Web page visited is categorized under the topics that it represents, allowing our customers to know the percentage of Web pages that are about any particular topic.

Presumably only SiteSell customers benefit from this; is there any reason not to block them?

fiestagirl

6:54 pm on Apr 26, 2006 (gmt 0)

10+ Year Member



Since I'm not getting a percentage, I don't see any reason to let them have their way with my sites.

IPs: 64.34.145.194-198