homepage Welcome to WebmasterWorld Guest from 54.166.122.65
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconIdentify a Connecticut spider
  Never saw one like this so thought I would ask
4Winston 10:37 pm on Oct 24, 2001 (gmt 0)
newpost thread iconcloaked google spider
 
3PeteU 7:47 pm on Oct 24, 2001 (gmt 0)
newpost thread iconAmanda_Spider/billy@al-info.com
  Rapid fire, but apparently legit seach engine bot
2LeBain 7:33 pm on Oct 24, 2001 (gmt 0)
newpost thread icon! New Slurp !
 
7toolman 8:50 pm on Oct 23, 2001 (gmt 0)
newpost thread iconMsFrontpage
 
5toolman 9:55 pm on Oct 22, 2001 (gmt 0)
newpost thread iconSpider databases?
  Downloadable databases with spider info?
4aetjansen 5:49 pm on Oct 22, 2001 (gmt 0)
newpost thread iconAnybody care to add any bots to this?
 
17BoneHeadicus 2:27 pm on Oct 22, 2001 (gmt 0)
newpost thread iconhttp://169.207.41.120/login.asp
 
4jeremy_goodrich 10:11 pm on Oct 21, 2001 (gmt 0)
newpost thread iconAnyone familiar with Searchhippo.com?
  Fluffy the Spider!??
6Travoli 8:21 pm on Oct 17, 2001 (gmt 0)
newpost thread iconBrowser=Hunter/3.0 OS=undefined
  Requesting totally unrelated URLs....
5mivox 7:32 pm on Oct 17, 2001 (gmt 0)
newpost thread iconTool for Checking spider to index my web
  I want tool for checking spiders index my website
3maimax 5:49 pm on Oct 17, 2001 (gmt 0)
newpost thread iconOliver Perry and w3matter paid a visit
 
18Marcia 8:44 pm on Oct 16, 2001 (gmt 0)
newpost thread iconYet another new Scooter UA
  Details enclosed
1Will 4:22 pm on Oct 16, 2001 (gmt 0)
newpost thread iconMicrosoft spiders!
  From the bCentral Network
1Will 3:23 pm on Oct 16, 2001 (gmt 0)
newpost thread iconUser agent "-" (null)
  Are there any legitimate agents that use "-" (null) only?
5seifried 8:28 pm on Oct 15, 2001 (gmt 0)
newpost thread iconanyone seen this one
  217.27.131.25
4dolphin 1:39 pm on Oct 15, 2001 (gmt 0)
newpost thread iconIncy Wincy?
  Looking for some information on this one...
10Eric_Lander 9:47 am on Oct 15, 2001 (gmt 0)
newpost thread iconLycos Spider?
  Traces to Korea
4Will 3:39 pm on Oct 11, 2001 (gmt 0)
newpost thread iconIndy Library
 
6Marcia 3:27 pm on Oct 11, 2001 (gmt 0)
newpost thread iconScoreBot/5
 
6Son_House 11:03 pm on Oct 10, 2001 (gmt 0)
newpost thread iconNew NorthernLight bot
 
2littleman 1:44 am on Oct 10, 2001 (gmt 0)
newpost thread iconSlurp/2.0-Kiteweekly?
  Kiteweekly?
6grnidone 6:19 pm on Oct 9, 2001 (gmt 0)
newpost thread iconMozilla/3.Mozilla/2.01 (Win95; I)
  from nucleus.com
6idiotgirl 9:18 am on Oct 9, 2001 (gmt 0)
newpost thread iconArchitextSpider
 
1littleman 1:23 am on Oct 9, 2001 (gmt 0)
newpost thread iconMozilla/3.0 NAVIO (dtv0)
  Verio - Best.com - and Ravenous
2bobriggs 6:16 am on Oct 6, 2001 (gmt 0)
Displaying Page 194 of 216<< Back 1 ... 184 185 186 187 188 189 190 191 192 193 [ 194 ] 195 196 197 198 199 200 201 202 203 ... 216 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved