Welcome to WebmasterWorld Guest from 54.163.40.152

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
IEPZv3.0
Is this a search engine or just a weird user-agent?
3 Pushycat 8:02 pm Jul 28, 2002
is this new or old - obot
213.252.152.12
3 nancyb 4:54 pm Jul 28, 2002
Email Extractor 2002?
who and why........
2 Bluetuna 7:30 pm Jul 27, 2002
grub-client
Can't figure out why .htaccess is blocking.
6 bobothecat 9:18 pm Jul 26, 2002
zSearch
2 volatilegx 6:53 pm Jul 26, 2002
.htaccess file failure
MSIECrawler was allowed in
6 misosoph 10:24 pm Jul 25, 2002
LycosUK1; FREESERVE_IE5
This took the most hits per visit - never seen it before
2 Again 8:36 pm Jul 24, 2002
Current IP List
2 Brett_Tabke 4:03 pm Jul 24, 2002
ZyBorg 1.0 (zyborg@wisenutbot.com)
216.34.42.211
18 skirril 3:56 pm Jul 24, 2002
cadabra.com webcrawler
Have you seen this?
5 coconutz 8:29 pm Jul 22, 2002
What is Gigabot ?
4 bcc1234 9:34 pm Jul 21, 2002
Mercator-2.0
Does anyone know what Mercator-2.0 is?
5 davros 3:36 am Jul 21, 2002
C-macos8
4 wilderness 12:08 am Jul 21, 2002
flunky -- anyone seen this spider?
66.28.20.194 flunky -- crawling my sites.
16 gethan 10:52 pm Jul 20, 2002
JOC Web Spider
Another leech to ban...
1 Key_Master 9:56 pm Jul 20, 2002
Two new non-se spiders?
Convera Internet Spider V6.9 & Webdup/0.9
1 Dreamquick 1:01 pm Jul 20, 2002
add2.dir.scd.yahoo.com
4 smokin 10:21 pm Jul 19, 2002
Openfind
4 volatilegx 3:16 pm Jul 19, 2002
crawler3.wib.pa-x.dec.com ?
Anyone recognize this Spider?
5 24bit 4:33 am Jul 19, 2002
openfind wont go away....
6 Dpeper 11:05 pm Jul 18, 2002
Java1.3.1 user agent
grabbing pages via wireless network?
3 idiotgirl 1:36 pm Jul 18, 2002
Lachesis
venomous snake or weird bot?
3 idiotgirl 6:19 pm Jul 17, 2002
212.30.114.9
Does anyone know who this is ?
7 Visit_Thailand 1:10 pm Jul 17, 2002
spider.batsch.com
Does anyone have info on this spider?
5 smokin 6:32 pm Jul 16, 2002
64.29.137.164
this ring a bell for anyone?
3 Weblamer 5:41 pm Jul 16, 2002

Featured Threads

Hot Threads This Week

Hot Threads This Month