homepage Welcome to WebmasterWorld Guest from 184.73.119.213
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconSpider Identificatioon script
  How many visits from googlebot ? Referals ? etc..
2Thierry_Zoller 9:53 am on Jun 10, 2002 (gmt 0)
newpost thread iconInktomi Random Agent header ?
  MonkeysNuts/5.01 [Its the dogs)
3Thierry_Zoller 9:46 am on Jun 10, 2002 (gmt 0)
newpost thread iconYet more Alavaista User-Agents
  When will ever stop making new ones?
2Josk 9:45 am on Jun 10, 2002 (gmt 0)
newpost thread iconFast WebCrawler 3.6
  Is this new?
4coconutz 6:27 pm on Jun 9, 2002 (gmt 0)
newpost thread icon66.150.40.220
  Can anyone identify it?
5Birdman 11:25 am on Jun 9, 2002 (gmt 0)
newpost thread iconFirstGov.gov Search - POC:firstgov.webmasters@gsa.gov
  Is this for real?
5Key_Master 5:15 am on Jun 9, 2002 (gmt 0)
newpost thread iconBrainysearch
  64.57.64.90
1volatilegx 11:45 pm on Jun 7, 2002 (gmt 0)
newpost thread iconSnoopy_v0.1
 
4korkus2000 3:34 pm on Jun 5, 2002 (gmt 0)
newpost thread iconBlitzBOT@tricus.net ?
 
3bull 3:54 pm on Jun 4, 2002 (gmt 0)
newpost thread icon65.24.37.57 - toto
  toto? - no referrer, no ua
6misosoph 4:32 am on Jun 4, 2002 (gmt 0)
newpost thread iconUnwanted Spiders - how to limit/kill access
  simple ways to code, spiders list etc.
3lak12 7:56 pm on Jun 3, 2002 (gmt 0)
newpost thread iconscooter/1.0 (netscan.fr)
  Is this Alta Vista?
3volatilegx 5:51 pm on Jun 3, 2002 (gmt 0)
newpost thread iconMonitoring bot activity with a script?
 
8Bluestreak 1:00 am on Jun 3, 2002 (gmt 0)
newpost thread iconCharter
  My apologies
1wilderness 9:54 pm on Jun 2, 2002 (gmt 0)
newpost thread iconautoemailspider
  email harvester or poorly named spider?
3zem 12:48 am on Jun 2, 2002 (gmt 0)
newpost thread iconDiaGem
  Another bot to ban
6Son_House 6:03 am on Jun 1, 2002 (gmt 0)
newpost thread icon216.200.130.207
  Ask Jeeves Spider?
3Key_Master 7:15 pm on May 31, 2002 (gmt 0)
newpost thread iconnew google spider IP?
  64.95.79.195
5chiefmonkey 5:44 pm on May 31, 2002 (gmt 0)
newpost thread iconNetResearchServer/2.2
  Another new name for IncyWincy
2mbauser2 7:04 am on May 31, 2002 (gmt 0)
newpost thread iconAlexa impersonator?
  Is someone faking an Alexa spider?
6Ralph_Slate 10:20 am on May 30, 2002 (gmt 0)
newpost thread iconnew FAST IPs
  just found these
7volatilegx 9:10 am on May 30, 2002 (gmt 0)
newpost thread iconIs this a spider
  messes up my logfiles
4MarkArt 4:01 am on May 30, 2002 (gmt 0)
newpost thread iconUsing mod_rewrite to stop bad spiders
  Where is it?
5transistor 12:47 am on May 30, 2002 (gmt 0)
newpost thread iconWhat is too much...
 
2opulyst 11:55 pm on May 29, 2002 (gmt 0)
newpost thread iconLegit Spider Usage?
  Are there ways I can use spiders that don't cause problems for site owners?
2OpeRabbit 8:40 pm on May 29, 2002 (gmt 0)
Displaying Page 184 of 216<< Back 1 ... 174 175 176 177 178 179 180 181 182 183 [ 184 ] 185 186 187 188 189 190 191 192 193 ... 216 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved