Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  what kind of spider is it if at all?
3 nube 2:42 pm Jan 27, 2001
  appie/1.1
5 Froggyman 12:04 am Jan 27, 2001
  Whois client
5 BoneHeadicus 6:47 pm Jan 26, 2001
  spider/0.01
3 Froggyman 1:19 am Jan 26, 2001
  Mozilla
Search engine idenification
3 junebug 9:25 pm Jan 25, 2001
  Where Can A Newbie Find More Info?
I need to learn more...
5 jingleheimer 11:07 pm Jan 24, 2001
  Help identifying
new spider in my log
8 luckynh 7:06 pm Jan 24, 2001
  AvantGo
2 oilman 11:07 pm Jan 19, 2001
  Girafa.com
10 mark_roach 3:12 pm Jan 19, 2001
  Infoseek Sidewinder
Some new spider flavors
3 Fusioneer 12:37 am Jan 19, 2001
  does anyone have more info
petersnews - who are they?
8 jennifer 4:59 pm Jan 16, 2001
  Slurp/2.0-MakoCrawl
Any Info on this one
9 cirelle 1:20 pm Jan 15, 2001
  h-208-12-52-94.netscape.com - Robozilla/1.0
Who's this? Any ideas?
4 mivox 12:03 pm Jan 15, 2001
  Spiders I Hate
I really HATE to see this in my logs!
13 scott 8:56 pm Jan 14, 2001
  Newbie - Can spiders go bezerk?
This spider sucks the same page over and over again
8 Macguru 12:07 am Jan 14, 2001
  Sc2_Merc_resh_37_1_C-1.0
Is this new
2 BoneHeadicus 6:10 pm Jan 13, 2001
  A new visitor from Google?
Hopefully the unblocking agent!
5 makemetop 9:23 am Jan 13, 2001
  inktomi1-mid.server.ntl.com
whodat?
3 BoneHeadicus 12:05 am Jan 12, 2001
  Robot from Cisco Systems?
6 msgraph 6:07 pm Jan 10, 2001
  Whatzup?
23 BoneHeadicus 11:11 pm Jan 8, 2001
  What spider is this?
ru-robot
4 merlin78 4:54 am Jan 8, 2001
  New sighting: JennyBOt/0.1
3 skirril 2:48 am Jan 8, 2001
  vspider
2 Steph 2:08 am Jan 8, 2001
  Fast's Mozilla spider
11 littleman 7:07 pm Jan 6, 2001
  Newbie - what is cr001.digital-integrity.com?
Are we beeing checked for cloaking?
5 Macguru 8:24 am Jan 6, 2001