CogentCo

[keyplyr]

Anyone know of a reason why I shouldn't block this entire backbone?

38.0.0.0/8

Over the last couple years I've received more trouble from PSINet/Cyveillance/CogentCo ranges than the clouds almost. Besides ScoutJet, what other white hats would I be blocking?

[Staffa]

On several sites I have the whole range blocked for several years and lost less than a handfull of regular visitors over those years. It's a shame but not worth the headache of having to deal with all the junk coming from there ;)

[dstiles]

I block sub-ranges when I discover they are server farms but otherwise give them a chance.

I currently block scoutjet's two ranges as they are STILL not up and running. I notice, though, that they are following a recent trend in specifying their crawling IP ranges on their web site. A definite move to the good. :)

[skrenta]

Appreciate the consideration given to ScoutJet. Yes we haven't launched yet, no one is more eager than I am to get this product out the door, but as you all know launching a new search engine can be somewhat perilous for new companies if you don't get it right. So we're trying to get it right.

[dstiles]

Thanks for popping in to reassure us, skrenta.

My blocking scoutjet is a general thing: with all the bots around trying for my bandwidth I prefer a return on it - ie visitors and trade. :)

Any idea when the engine is likely to go live? Not that we want you to do a Cuil launch, of course. :)

[skrenta]

Yeah I understand. I have a personal site, I see all the crazy bots myself, there really are an astonishing number of them running wild all over the web.

Can't give a firm launch date yet but should be in the near future. Hopefully we'll be in a position to start giving beta invites out to folks soon. I appreciate the patience with us.

[jdMorgan]

The problem with CogentCo/PSInet's 38/8 range is that there are an increasing number of "corporate connections" being leased out in that range. I used to block the whole range, but find myself opening up more and more sub-ranges for my users "checking in" from work. I tell them, "Well I opened it up for you, but it's still probably against your company policy to surf a hobby site from work..." :)

There are also several ISPs (mostly wireless) leasing parts of that range now, as well as StumbleUpon, Kosmix search, GigaBlast, and the CyberPatrol web filter, all of which I allow.

Jim

[keyplyr]

And I think Snap (SnapBot, SnapPreviewBot) is 38/8 as well. OK, guess the easy block isn't going to work. I didn't really think it would, hence my inquiry.

[dstiles]

skrenta - thanks for your understanding. Look forward to the announcement. :)