Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  OrangeBot sniffing about yesterday
5 engine 11:12 am Aug 9, 2002
  UdiSearch
coming from Yahoo
2 Key_Master 6:17 am Aug 9, 2002
  211.154.211.209
heads up, spider faking user agent Googlebot
5 Key_Master 1:42 am Aug 9, 2002
  ah-ha.com crawler
Why are they crawling, i donīt use them and they are pure PPC engine?
5 lazerzubb 8:06 pm Aug 8, 2002
  Scooter-3.2.TF
Is this from Altavista
2 allybongo 5:31 pm Aug 8, 2002
  trek29.sv.av.com As an IP Address Making Requests
Is this AV, or someone else?
4 Eric_Lander 12:00 am Aug 8, 2002
  Is this a spider?
208.184.139.82.speedera.com
2 egghere 6:22 pm Aug 6, 2002
  mogimogi/1.0
Anyone know this one?
4 korkus2000 6:18 pm Aug 5, 2002
  Flickbot and Symantec Notify Internet
Anyone have any info
2 madamjujujive 3:26 am Aug 3, 2002
  Whois Cogent Communication Inc.?
I get spidered by these guys a lot - who are they really?
12 jrota 2:21 pm Aug 2, 2002
  larbin
bringing up an old topic
7 Big_Balou 7:22 am Aug 2, 2002
  Zombie crawlers with a referrer sig?
We're getting hit from various places
11 Everyman 8:05 am July 31, 2002
  scanner.infoseek.com
204.202.132.19 is touching me all over...
3 EliteWeb 11:00 pm July 30, 2002
  Zeus ThemeSite Viewer
Multiple Stat Log Entries for Mod-Rewrite
3 DrLou 8:33 pm July 29, 2002
  CoreSearch Bot Build 1.1548795
Any one seen this little guy
3 korkus2000 5:26 pm July 29, 2002
  JSK robot ver 4.122
Anyone seen this?
5 korkus2000 6:50 am July 29, 2002
  Who am i?
Snoopy the spider? v0.1
2 Dpeper 12:14 am July 29, 2002
  IEPZv3.0
Is this a search engine or just a weird user-agent?
3 Pushycat 8:02 pm July 28, 2002
  is this new or old - obot
213.252.152.12
3 nancyb 4:54 pm July 28, 2002
  Email Extractor 2002?
who and why........
2 Bluetuna 7:30 pm July 27, 2002
  grub-client
Can't figure out why .htaccess is blocking.
6 bobothecat 9:18 pm July 26, 2002
  zSearch
2 volatilegx 6:53 pm July 26, 2002
  .htaccess file failure
MSIECrawler was allowed in
6 misosoph 10:24 pm July 25, 2002
  LycosUK1; FREESERVE_IE5
This took the most hits per visit - never seen it before
2 Again 8:36 pm July 24, 2002
  Current IP List
2 Brett_Tabke 4:03 pm July 24, 2002