Forum Moderators: open

Message Too Old, No Replies

CyberPatrol SiteCat Webbot

It crawls the internet looking for harmful sites

         

thetrasher

3:24 pm on Jun 9, 2008 (gmt 0)

10+ Year Member



38.103.17.### - - [09/Jun/2008] "GET /robots.txt HTTP/1.1" 200 ... "-" "-"

User-agent: *
Disallow: /

38.103.17.### - - [09/Jun/2008] "GET / HTTP/1.1" 403 - "-" "CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp)"

38.103.17.160/27 = Cyber Patrol LLC

Will my harmless website now be considered harmful?

Staffa

4:27 pm on Jun 9, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I can't answer your question for your site but I have banned the whole 38.nnn.nnn.nnn range a long time ago.
Too much unsavoury visitors from there and since my sites are all clean and can be viewed by everyone from 9-99 I have no need for those self-appointed 'web and content filtering' bandwidth wasters.

Samizdata

6:32 pm on Jun 9, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



CyberPatrol is a commercial "net nanny" software package for Windows.

In 2008, a group of private investors acquired CyberPatrol from security vendor Websense, Inc

I am not a fan of filtering software but some parents use such programs to protect their children, and though I personally wouldn't use their approach I respect their intentions. They want to feel confident that any website their child comes across has been:

carefully researched by a global team of professional researchers and categorized according to type

It seems that in secret bunkers around the world there are legions of highly-trained operatives toiling day and night, bravely exposing themselves to millions of "inappropriate" websites in order to add them to... the CyberLIST.

This crusading mission requires that every site on the web should submit to regular inspection from the moment it goes live, that its robots.txt file should always be read but never respected, and that the bandwidth cost should be borne by the webmaster.

Will my harmless website now be considered harmful?

Downloading the free trial is one way to find out.

...

Staffa

7:31 pm on Jun 9, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"acquired ... from ... Websense"

LOL, that one has been banned for years.

Megaclinium

4:31 am on Jul 7, 2008 (gmt 0)

10+ Year Member



I had cyber patrol visit my site and irritatingly create 404 errors.

Why?

Because I have a non windoze server where the case of the URL matters,
and cyberpatrol turned everything to lower case!

Guess I'll have to add upper case and spaces to my URLs to tick off dumb bots! (evil grin :)