homepage Welcome to WebmasterWorld Guest from 54.166.105.24
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread icon63.210.161.34 Slightly less annoying...
  Microsoft URL Control: 33 pages in 20 secs?
3mivox 6:48 pm on Dec 7, 2000 (gmt 0)
newpost thread iconObnoxious behavior from 63.86.155.41
  Can't track it down...
6mivox 6:46 pm on Dec 7, 2000 (gmt 0)
newpost thread iconFast? Crawler
  Strange
5BoneHeadicus 3:14 pm on Dec 3, 2000 (gmt 0)
newpost thread iconMicrosoft URL Control
  what was it that littleman said?
2han solo 5:52 pm on Nov 30, 2000 (gmt 0)
newpost thread iconpossible spider...
  216.161.154.93 ua Mozilla/4.0+(compatible;+MSIE+5.0;+Windows
7han solo 2:50 pm on Nov 30, 2000 (gmt 0)
newpost thread iconInk / PositionTech spider
 
1oLeon 2:04 pm on Nov 30, 2000 (gmt 0)
newpost thread iconIs this ink?
  62.252.160.5 ip looks up to inktomi2-lan.server.ntl.com
7han solo 4:38 pm on Nov 29, 2000 (gmt 0)
newpost thread iconSmart Whois
 
2BoneHeadicus 4:27 pm on Nov 28, 2000 (gmt 0)
newpost thread iconApache Guardian
 
2BoneHeadicus 8:26 pm on Nov 25, 2000 (gmt 0)
newpost thread iconLexiBot/1.00
  who is this?
3han solo 2:29 pm on Nov 24, 2000 (gmt 0)
newpost thread iconJennyBot
  Who is she?
8scott 11:13 am on Nov 24, 2000 (gmt 0)
newpost thread iconPJSPider
 
2Abe 4:13 pm on Nov 21, 2000 (gmt 0)
newpost thread iconSpaceBison/0.01
  any ideas/thoughts?
4han solo 3:15 pm on Nov 21, 2000 (gmt 0)
newpost thread iconTwo spider owners that need slapped
 
2Brett_Tabke 11:53 am on Nov 21, 2000 (gmt 0)
newpost thread icon12.25.194.37 is a surfer, or spider?
  tracert shows velocity isp company...
4han solo 4:58 pm on Nov 20, 2000 (gmt 0)
newpost thread iconGood identification spider book?
  Spiders
7Melanie 7:59 am on Nov 19, 2000 (gmt 0)
newpost thread iconWho is this
  cm-24-161-36-192.nycap.rr.com
2stcrim 8:47 am on Nov 17, 2000 (gmt 0)
newpost thread iconmass banning spiders
  I am considering blocking all spiders...
3han solo 2:28 pm on Nov 16, 2000 (gmt 0)
newpost thread iconHaven't seen this slurp before
 
2eljefe3 5:37 am on Nov 10, 2000 (gmt 0)
newpost thread iconAnyone Seen This Crawler
 
1redzone 6:40 pm on Nov 8, 2000 (gmt 0)
newpost thread iconInktomi User Agent change
  ..if anyone still cares
5Air 9:01 am on Nov 7, 2000 (gmt 0)
newpost thread iconLEIAcrawler?
 
2Ulrike 1:49 pm on Nov 2, 2000 (gmt 0)
newpost thread icon164.124.250.214
  164.124.250.214
5roscoepico 8:48 pm on Nov 1, 2000 (gmt 0)
newpost thread iconWhat is this all about?
 
4eljefe3 8:46 pm on Nov 1, 2000 (gmt 0)
newpost thread iconList of User Agents
 
3tollervey 4:33 pm on Nov 1, 2000 (gmt 0)
Displaying Page 210 of 215<< Back 1 ... 200 201 202 203 204 205 206 207 208 209 [ 210 ] 211 212 213 214 215 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved