Welcome to WebmasterWorld Guest from 220.127.116.11 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
Who is this? Are these SE spiders? Dumpy msg:407719 8:36 am on Jul 11, 2000 (gmt 0) Gulliver/1.3 LEIA/2.90 user49.davesengine.com ia_archiver libwww-perl DIIbot geckobot ru-robot Mata Hari EmailSiphon logikabot zzZ Microsoft URL Control - 6.00.8169 WhizBang! Lab oBot ((compatible;Win32)) PhotoRecall webbandit NationalDirectory-WebSpider NationalDirectory-SuperSpider lwp-trivial FinancialFind Link Verification Openfind Robot PJspider SiteSnagger SurfWalker Mercator-1.0 Spider RealNamesBot Excalibur Internet Spider V6.5.4 ZyBorg xyro_(firstname.lastname@example.org)
littleman msg:407720 8:39 am on Jul 12, 2000 (gmt 0)
Well Dumpy, To give you an explanation for each one of those would take all day. So instead I'll point you here [ info.webcrawler.com]
You'll find a lot (not all) of your answers there. Others are personal bots or the module bots for scripting language utilities. A couple you have there are new and you are going to have to do some digging to get the scoop on. A couple of them are site rippers designed to steal content or emails.
xyro_(email@example.com) has ben catching my eye lately - they seem to be crawling inktomi results You could read about them
here [ inria.fr] . I'm not sure if anything is going to come from all their crawling.
Oh, btw I still do not know what zzZ is.
NFFC msg:407721 9:42 am on Jul 12, 2000 (gmt 0)
>Oh, btw I still do not know what zzZ is
Brett_Tabke msg:407722 12:18 pm on Jul 13, 2000 (gmt 0)
Ones I know off the top:
northern light Gulliver/1.3
a personal bot: LEIA/2.90 nobody: user49.davesengine.com archive.org: ia_archiver nobody using perl: libwww-perl email raider: EmailSiphon altavista/digital research spider: Mercator-1.0
webguy msg:407723 4:06 am on Jul 24, 2000 (gmt 0)
Here are a few more:
[ ...] whizbang.com Web page info extraction software
[ ...] openfind.com.tw Taiwan search engine
[ ...] realnames.com Internet keywords company
Excalibur Internet Spider V6.5.4
[ ...] excalib.com Excalibur Internet Spider (Spider for hire)
Edited by: webguy engine msg:407724 4:59 pm on Jul 24, 2000 (gmt 0)
NFFC LOL - I'd expect a lot more zzzzzz than that!