homepage Welcome to WebmasterWorld Guest from 54.237.98.229
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconWho is this?
  avfwclient.sv.av.com #UA roach.smo.av.com-1.0
1oLeon 10:54 am on Dec 19, 2000 (gmt 0)
newpost thread iconetchels-indexer?
  Anyone knows this spider?
2skirril 1:18 am on Dec 19, 2000 (gmt 0)
newpost thread iconDoes anyone know which spiders get confused by frames?
 
2White_Rabbit 10:26 pm on Dec 18, 2000 (gmt 0)
newpost thread iconoddball do-it-yourself SE spiders
  cfw3.rdc1.nsw.excitehome.net.au
1mivox 9:05 pm on Dec 18, 2000 (gmt 0)
newpost thread iconPaying for Inktomi? You need to see this...
  Faked user agent for Inktomi's pay for play
1djuice999 10:49 pm on Dec 15, 2000 (gmt 0)
newpost thread iconAnother Slurp Mozilla spider
 
5msgraph 7:11 pm on Dec 15, 2000 (gmt 0)
newpost thread iconpowering the semantic web? invention-machine.com
  they've been spidering with IP 12.30.60.78
1han solo 4:44 pm on Dec 15, 2000 (gmt 0)
newpost thread iconDoes sympatico.ca run spiders?
  64.228.216.145 Mozilla/4.5 [en] (Win98; I)
6han solo 5:19 pm on Dec 13, 2000 (gmt 0)
newpost thread iconWho's This?
  atrax2.pa-x.dec.com (Mercator-2.0)
3mivox 1:24 pm on Dec 12, 2000 (gmt 0)
newpost thread iconInk Great White Crawl
 
2Brett_Tabke 9:28 pm on Dec 8, 2000 (gmt 0)
newpost thread iconNew Inktomi Japan User Agent
 
3littleman 2:47 pm on Dec 8, 2000 (gmt 0)
newpost thread iconip 64.5.69.112 user agent Java1.2.2 ideas?
  spider's been after me, but why?
4han solo 2:44 pm on Dec 8, 2000 (gmt 0)
newpost thread iconAnyone seen this & have any info?
 
9engine 1:16 pm on Dec 8, 2000 (gmt 0)
newpost thread icon63.210.161.34 Slightly less annoying...
  Microsoft URL Control: 33 pages in 20 secs?
3mivox 6:48 pm on Dec 7, 2000 (gmt 0)
newpost thread iconObnoxious behavior from 63.86.155.41
  Can't track it down...
6mivox 6:46 pm on Dec 7, 2000 (gmt 0)
newpost thread iconFast? Crawler
  Strange
5BoneHeadicus 3:14 pm on Dec 3, 2000 (gmt 0)
newpost thread iconMicrosoft URL Control
  what was it that littleman said?
2han solo 5:52 pm on Nov 30, 2000 (gmt 0)
newpost thread iconpossible spider...
  216.161.154.93 ua Mozilla/4.0+(compatible;+MSIE+5.0;+Windows
7han solo 2:50 pm on Nov 30, 2000 (gmt 0)
newpost thread iconInk / PositionTech spider
 
1oLeon 2:04 pm on Nov 30, 2000 (gmt 0)
newpost thread iconIs this ink?
  62.252.160.5 ip looks up to inktomi2-lan.server.ntl.com
7han solo 4:38 pm on Nov 29, 2000 (gmt 0)
newpost thread iconSmart Whois
 
2BoneHeadicus 4:27 pm on Nov 28, 2000 (gmt 0)
newpost thread iconApache Guardian
 
2BoneHeadicus 8:26 pm on Nov 25, 2000 (gmt 0)
newpost thread iconLexiBot/1.00
  who is this?
3han solo 2:29 pm on Nov 24, 2000 (gmt 0)
newpost thread iconJennyBot
  Who is she?
8scott 11:13 am on Nov 24, 2000 (gmt 0)
newpost thread iconPJSPider
 
2Abe 4:13 pm on Nov 21, 2000 (gmt 0)
Displaying Page 210 of 216<< Back 1 ... 200 201 202 203 204 205 206 207 208 209 [ 210 ] 211 212 213 214 215 216 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved