Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  A CSS and JS sniffer?
Can't track this one
5 Macguru 4:55 pm Sept 7, 2001
  AtlantisSearch/0.1b webmaster@jippii.fi
195.211.11.50
2 volatilegx 5:27 pm Sept 6, 2001
  bumblebee@relevare.com
12 Son_House 4:51 pm Sept 6, 2001
  Mercator
TV33_Mercator_1-1.0
11 startup 3:44 pm Sept 6, 2001
  A Sneaky Spider
what the heck is compete.com spidering for?
6 idiotgirl 9:18 am Sept 6, 2001
  Fetch API?
2 Josk 2:25 pm Sept 5, 2001
  Unidentified Crawler: (Indy Library)
Looking for any information about the following message.
2 JDDJ 7:53 pm Sept 4, 2001
  Lynx viewer
doesn't see a page
4 Abe 11:50 am Sept 2, 2001
  Spider
Need IDENTIFICATION
2 creepycrawler 2:50 am Aug 31, 2001
  scooter-3.0.vns
new to me
10 Marcia 7:00 pm Aug 30, 2001
  Is this a new spider
9 TerryS 9:24 pm Aug 29, 2001
  SMS service
How do i make a SMS service?
2 ddsworld 5:03 pm Aug 29, 2001
  Picsearch == deny from
2 toolman 4:36 pm Aug 29, 2001
  Mysterious
24.216.220.210
3 volatilegx 11:10 pm Aug 28, 2001
  How do i make a search engine?
make search engines?
9 ddsworld 4:36 pm Aug 28, 2001
  Microsoft+URL+Control
65.113.184.110
4 Crazy_Fool 10:20 am Aug 28, 2001
  spider identification
never seen this spider in MN before help identify
5 jnlomn 2:51 am Aug 28, 2001
  MindSpider/1.0
new spider?
3 volatilegx 11:18 pm Aug 27, 2001
  another one to stick in the garbage pile
5 littleman 10:44 pm Aug 27, 2001
  morgue1.corp.yahoo.com
216.145.54.35
2 volatilegx 11:27 pm Aug 24, 2001
  list of spiders
i found this
2 mack 10:32 pm Aug 24, 2001
  I don't know if anyone cares...
9 littleman 7:21 pm Aug 24, 2001
  Browser User Agents
13 Josk 7:16 pm Aug 24, 2001
  Wget/1.6
3 requests in 10 hrs
6 bobriggs 6:11 pm Aug 22, 2001
  Fast Heads Up
3 toolman 10:30 pm Aug 21, 2001