ZyBorg 1.0 ([e-mail])

216.34.42.211

[skirril]

came from: 216.34.42.211
grabbed robots.txt twice (in the same second)nothing else.

ID is ZyBorg/1.0([e-mail],http://www.WISEnutbot.com)

the url indicated features a page that only states "under
construction"

To me this robot could be a nightrmare if it keeps up that page (how many hits can you handle per second?)

[skirril]

I need to add a clarification.

Said bot came back, and crawled the whole site.

Seems to be better behaved than I first thought.

2 requests in an interval of about a minute (usually HEAD and GET), then a pause of 5 mins or
more, then another 2 requests.

Also, it seems to honor robots.txt (which it only gets once per 24 hr interval or so)

All requests came from 216.34.14.42.14

[BoneHeadicus]

There are 3 or 4 "generic" spiders that come around consistantly as can be seen from the postings here at WmW.

Theres JennyBot, Alexa, WiseNutBot and that one from from Rutgers U. I dont have the UA's in front of me but these are pretty constant. Oh that one from Digital-Integrity too. There's probably more than this but I remember these off the top of my head.

I think it's becoming fashionable in certain circles to have your own "bot" to go out and conquer the web. Next we'll have "bot wars" and "gladiator bots" and "battle of the bots".

Maybe I should build my own "BoneHeadicusBot"...that would be a scary UA in your logs.

Hey littleman, Air? Yall up to it? We could build one called BodaciousBot.;)

[skirril]

Ok, some more thoughts on it.

I was hit 72 times by the bot over a period of 3 days.

Robot does not seem too smart about modification, it got some pages several times (without them having been modified)

robots.txt is gotten once or twice per period of 24 hrs. dont know about the META tag, robots.txt seems to be honored, though.

URL indicated in the robot (http://wisenutbot.com) is still 'under construction'

[BoneHeadicus]

This is all I got so far:

auth-area 216.34.0.0/16
class-name network
network-name 216.34.42.0
ip-network 216.34.42.0/24
organization Wizenut
address-1 1333 Lawrence Expressway Suite 269
address-2 Santa Clara, CA 95051
admin-contact [e-mail]
tech-contact [e-mail]
created 00-APR-4
updated-by chuck

--------------------------------------------------------------------------------
auth-area 216.34.0.0/16
class-name network
network-name 216.34.40.0
ip-network 216.34.40.0/22
organization Exodus Communications
address-1 2650 San Tomas Expressway
address-2 Santa Clara, CA 95051
admin-contact [e-mail]
tech-contact [e-mail]
created 99-DEC-22
updated-by clay

[BoneHeadicus]

This sheds some light on it.

[findarticles.com ]

[skirril]

BoneHeadicus

very interesting information, thanks indeed.

Why a company so highly endowed in human resources and capital is unable to put up a site about their bot, with the usual infos (honors robot exclusion std, does/does not honor meta tags, will (not) flood your site with requests) is a mystery.

Thanks alot

[Kimihia]

[wisenut.com...]

[JuniorHarris]

Korea WiseNut [kr.wisenut.com]

Anyone getting traffic from WiseNut, other than spiders?

[Machiavelli]

No referals or anything, just wildly enthusiastic spidering.

[Xoc]

Well, I just banned them at the firewall. They rarely retrieve robots.txt, and I have no idea what string to put in it to ban them there, anyway. They don't have any information on their web site. Banned the whole class C of 216.34.42.*. They do a deeeeep crawl, just hammering my server. They've been by almost every day this month.

If they ever turn out relevant, I'll unban them. But for now, they're gone.

If anybody figures out what to put in robots.txt to identify their spider, let me know.

[pikaia]

Oh, that's fine that there is a ZyBorg forum.
I've watched ZyBorg visiting my private homepage again and again during the last weeks and I have been close to giving it a complete disallow in my robots.txt file (@Xoc: I think I would have tried "ZyBorg/1.0" ).

Thanx to Kimihia for having found out that www.wisenut.com is now online.

I've just asked them to send me a user name and password for their trial version and I am really curious about the results for my testing search strings. I'll tell you more as soon as I've found out...

[JuniorHarris]

I asked for a username/password for the demo, but never even got a response back.

[Machiavelli]

I emailed these people and this is taken from their reply:

The WISEnut search engine can crawl and index more than 50 million Web documents a day....By the
full launch, the WISEnut search database is expected to contain some 800 million documents... We plan to publicly launch our engine by Spring 2001.

So we shall just have to wait and see.

[Machiavelli]

For convenience, here are all the previous threads which may be relevant to this "search engine":

Mid-Late February 2001 [webmasterworld.com]
Mid February 2001 [webmasterworld.com]
Early February 2001 [webmasterworld.com]
Late November 2000 [webmasterworld.com]
Late October 2000 [webmasterworld.com]
July 2000 [webmasterworld.com]

[Son_House]

Got hit by ZyBorg yesterday and it looks like they have a new IP and UA.

66.35.208.60

"Mozilla/4.0 compatible ZyBorg/1.0 ([e-mail]; [WISEnutbot.com)"...]

[volatilegx]

Just came across a new IP for Zyborg...
209.249.67.101

[korkus2000]

Also new UA for Zyborg is:

Mozilla/4.0 compatible ZyBorg/1.0 ([e-mail]; [WISEnutbot.com)...]