The Big List

Identify the good guys...

[hanuman]

Ok. Here is a list of bad guys and good guys. Please identify the good guys.....

Java 1.1
Zao
Python urllib
Konqueror
Franklin Locator 1.8
Mac Finder 1.0.38
Mac Finder 1.0.40
Lynx
webcollage
(unknown)
MSFrontPage
RPT HTTPClient
Missigua Locator 1.9
Links SQL
NPBot
Libby_1.1
NPBot
Rotondo
semanticdiscovery
Microsoft WebDAV MiniRedir
Microsoft Data Access Internet Publishing Provider DAV 1.1
MSNBOT
toCrawl
Java
Java1.3.1
Xenu s Link Sleuth 1.1a
Mac Finder 1.0.37
/xd3/xca/xbc/xfe/xcb/xd1/xcb/xf7/xcd/xf5
Microsoft Data Access Internet Publishing Provider DAV
Program Shareware 1.0.3
Java1.1.8
Under the Rainbow 2.2
Big Brother
Art Online.com 0.9
CFNetwork
Crawl_Application
PageFetcher
Mac Finder 1.0.43
Keiner weiss wer`s ist
mogimogi
Mac Finder 1.0.39
AOLserver Tcl
Microsoft Data Access Internet Publishing Provider Protocol Discovery
Industry Program 1.0.9
Microcomputers Etc.
UP.Browser
WEP Search 00
Java1.3.1_02
MarkWatch
combine
IUPUI Research Bot v 1.9a
Program Shareware 1.0.2
Gigabot
Microsoft Data Access Internet Publishing Provider Cache Manager
QuepasaCreep v0.9.13
DoCoMo
dloader
China Local Browse 2.6
Openbot
Microsoft Internet Explorer v5.5
Xenu Link Sleuth 1.2d
DeepIndex
Firefly
Program Shareware 1.0.1
MFC_Tear_Sample
Mac Finder 1.0.36
SURF
GornKer Crawler
Mac Finder 1.0.22
Java1.1.7
EasyDL
PlantyNet_WebRobot_V1.9 [e-mail]
SlimBrowser
COMBINE
iCab
Links 2.0
W3C checklink
NetResearchServer
SurveyBot
Microsoft Internet Explorer
HTML2JPG Blackbox, http:
Java1.3.1_04
LinksManager.com
Gozilla
Xenu Link Sleuth 1.2b
MSProxy
PHP
sjkkhf8

[wilderness]

Bad Guys
[webmasterworld.com...]

BTW just because somebody hit this list doesn't necessarily mean they are bad.
Only that a webmaster(s) has made a decision to deny access to that bot.
The reasons may be numerous and have nothing to do with character, morals or nature.

[tedster]

A classic example of a judgement call is the spider "asterias". It's a spider for the media content search engine "Singing Fish" -- if you're promoting music, books on tape, etc, then you might welcome some attention from asterias. Singing Fish provides results to the Real Player search, for instance.

But especially in the early days of Singing Fish, asterias was a pretty unruly bot and it hammered sites over and over -- hence it often appears in ban lists.