Welcome to WebmasterWorld Guest from 54.145.13.215

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Adwords Spider
(and no -- its not from Google)
2 Josk 10:23 am Nov 7, 2002
Pop.gr/6.1
ip: 195.186.149.91
2 PandaM 9:54 am Nov 7, 2002
rico/0.1
11 PandaM 4:05 am Nov 7, 2002
Perlscript Downloading Images
12-228-84-214.client.attbi.com; libwww-perl/5.65
4 weesnich 9:59 am Nov 6, 2002
Full Web Bot 0516B
no robots.txt, private bot
4 bull 4:16 pm Nov 5, 2002
Does anyone know IPiumBot?
12 casualsub 8:00 pm Nov 4, 2002
NetNewsWire
2 wilderness 7:12 pm Nov 4, 2002
New Walhello Spider
Well, hello there little spider...
6 Josk 9:21 pm Nov 2, 2002
kototoi - zao
sounds friendly
3 john316 4:57 pm Nov 2, 2002
UA: THTTP: HTTP API Test Application
1 carfac 4:52 pm Nov 2, 2002
Netscape Spider? weird entry in logs....
2 kstprod 3:43 pm Nov 1, 2002
Anybody seen this one?
readwebpage
1 volatilegx 7:52 pm Oct 31, 2002
TECOMAC-Crawler/0.3
grabbed robots, no info
2 bull 7:38 pm Oct 31, 2002
Looking for info about Visoo
Image search service provided by Cobion
3 Busynut 2:20 am Oct 31, 2002
Does anybody recognize 213.137.109.74
Can't reach it and can't find it by search here.
4 quotations 6:20 pm Oct 30, 2002
Scooter/3.3
16 Key_Master 12:51 pm Oct 30, 2002
Server sided index by web crawler?
Need help
2 teenwolf2000 10:12 pm Oct 29, 2002
ExperimentalHenryTheMiragoRobot
Mirago testing new robot software.
8 DerekJPreston 9:52 pm Oct 29, 2002
How to block 1 file
2 stratocaster 9:46 pm Oct 29, 2002
HLoader?
1 file twice, no robots.txt
1 bull 7:34 am Oct 29, 2002
ScoutAbout
Any ideas?
7 themoff 2:40 am Oct 29, 2002
Speedy_Spider
Seems well behaved
2 carfac 10:26 am Oct 28, 2002
obot
anyone know german?
10 CuriousWeb 10:08 am Oct 28, 2002
Pompos?
Anyone? Anyone?
6 121focus 9:51 am Oct 28, 2002
65.162.25.97? Trying to go to forbiddin places......
Is this guy is spamming me or trying to give me virus?
2 kstprod 2:07 pm Oct 27, 2002