Welcome to WebmasterWorld Guest from 23.20.37.222

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Is this a spider?
208.184.139.82.speedera.com
2 egghere 6:22 pm Aug 6, 2002
mogimogi/1.0
Anyone know this one?
4 korkus2000 6:18 pm Aug 5, 2002
Flickbot and Symantec Notify Internet
Anyone have any info
2 madamjujujive 3:26 am Aug 3, 2002
Whois Cogent Communication Inc.?
I get spidered by these guys a lot - who are they really?
12 jrota 2:21 pm Aug 2, 2002
larbin
bringing up an old topic
7 Big_Balou 7:22 am Aug 2, 2002
Zombie crawlers with a referrer sig?
We're getting hit from various places
11 Everyman 8:05 am Jul 31, 2002
scanner.infoseek.com
204.202.132.19 is touching me all over...
3 EliteWeb 11:00 pm Jul 30, 2002
Zeus ThemeSite Viewer
Multiple Stat Log Entries for Mod-Rewrite
3 DrLou 8:33 pm Jul 29, 2002
CoreSearch Bot Build 1.1548795
Any one seen this little guy
3 korkus2000 5:26 pm Jul 29, 2002
JSK robot ver 4.122
Anyone seen this?
5 korkus2000 6:50 am Jul 29, 2002
Who am i?
Snoopy the spider? v0.1
2 Dpeper 12:14 am Jul 29, 2002
IEPZv3.0
Is this a search engine or just a weird user-agent?
3 Pushycat 8:02 pm Jul 28, 2002
is this new or old - obot
213.252.152.12
3 nancyb 4:54 pm Jul 28, 2002
Email Extractor 2002?
who and why........
2 Bluetuna 7:30 pm Jul 27, 2002
grub-client
Can't figure out why .htaccess is blocking.
6 bobothecat 9:18 pm Jul 26, 2002
zSearch
2 volatilegx 6:53 pm Jul 26, 2002
.htaccess file failure
MSIECrawler was allowed in
6 misosoph 10:24 pm Jul 25, 2002
LycosUK1; FREESERVE_IE5
This took the most hits per visit - never seen it before
2 Again 8:36 pm Jul 24, 2002
Current IP List
2 Brett_Tabke 4:03 pm Jul 24, 2002
ZyBorg 1.0 (zyborg@wisenutbot.com)
216.34.42.211
18 skirril 3:56 pm Jul 24, 2002
cadabra.com webcrawler
Have you seen this?
5 coconutz 8:29 pm Jul 22, 2002
What is Gigabot ?
4 bcc1234 9:34 pm Jul 21, 2002
Mercator-2.0
Does anyone know what Mercator-2.0 is?
5 davros 3:36 am Jul 21, 2002
C-macos8
4 wilderness 12:08 am Jul 21, 2002
flunky -- anyone seen this spider?
66.28.20.194 flunky -- crawling my sites.
16 gethan 10:52 pm Jul 20, 2002

Featured Threads

Hot Threads This Week

Hot Threads This Month