homepage Welcome to WebmasterWorld Guest from 54.237.95.6
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Accredited PayPal World Seller

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
Who is this?
Are these SE spiders?
Dumpy




msg:407719
 8:36 am on Jul 11, 2000 (gmt 0)

Gulliver/1.3
LEIA/2.90
user49.davesengine.com
ia_archiver
libwww-perl
DIIbot
geckobot
ru-robot
Mata Hari
EmailSiphon
logikabot
zzZ
Microsoft URL Control - 6.00.8169
WhizBang! Lab
oBot ((compatible;Win32))
PhotoRecall
webbandit
NationalDirectory-WebSpider
NationalDirectory-SuperSpider
lwp-trivial
FinancialFind Link Verification
Openfind Robot
PJspider
SiteSnagger
SurfWalker
Mercator-1.0
Spider
RealNamesBot
Excalibur Internet Spider V6.5.4
ZyBorg
xyro_(xcrawler@inria.fr)

 

littleman




msg:407720
 8:39 am on Jul 12, 2000 (gmt 0)

Well Dumpy,
To give you an explanation for each one of those would take all day. So instead I'll point you here [info.webcrawler.com]

You'll find a lot (not all) of your answers there. Others are personal bots or the module bots for scripting language utilities. A couple you have there are new and you are going to have to do some digging to get the scoop on. A couple of them are site rippers designed to steal content or emails.

xyro_(xcrawler@inria.fr) has ben catching my eye lately - they seem to be crawling inktomi results You could read about them here [inria.fr] . I'm not sure if anything is going to come from all their crawling.

added---
Oh, btw I still do not know what zzZ is.



NFFC




msg:407721
 9:42 am on Jul 12, 2000 (gmt 0)

>Oh, btw I still do not know what zzZ is

Probably webcrawler:)

Brett_Tabke




msg:407722
 12:18 pm on Jul 13, 2000 (gmt 0)

Ones I know off the top:

northern light Gulliver/1.3
a personal bot: LEIA/2.90
nobody: user49.davesengine.com
archive.org: ia_archiver
nobody using perl: libwww-perl
email raider: EmailSiphon
altavista/digital research spider: Mercator-1.0


webguy




msg:407723
 4:06 am on Jul 24, 2000 (gmt 0)

Here are a few more:

WhizBang! Lab
[whizbang.com...]
Web page info extraction software

Openfind Robot/1.1A2
[openfind.com.tw...]
Taiwan search engine

RealNamesBot/1.0
[realnames.com...]
Internet keywords company

Excalibur Internet Spider V6.5.4
[excalib.com...]
Excalibur Internet Spider (Spider for hire)

Edited by: webguy

engine




msg:407724
 4:59 pm on Jul 24, 2000 (gmt 0)

NFFC LOL - I'd expect a lot more zzzzzz than that!

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved