homepage Welcome to WebmasterWorld Guest from 107.22.45.61
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe and Support WebmasterWorld
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconGoGuidesSpamTracker
  Is this spider legit?
3grandma_genie 1:26 am on Jul 6, 2012 (gmt 0)
newpost thread iconLipperhey Link Explorer
  data mining software
2keyplyr 8:29 pm on Jul 5, 2012 (gmt 0)
newpost thread iconEzooms the New DotBot?
  née DotBot?
16Pfui 9:21 pm on Jul 4, 2012 (gmt 0)
newpost thread iconNew Softlayer IP Range
  Just heads-up
18blend27 10:44 pm on Jul 2, 2012 (gmt 0)
newpost thread iconwhat is this POST command and why did it get a 200?
 
22dupres01 1:44 pm on Jun 30, 2012 (gmt 0)
newpost thread iconOpal Telecom
 
3wilderness 8:51 pm on Jun 28, 2012 (gmt 0)
newpost thread icon80legs Flooding Site - Ignoring Robots.txt
  Literally thousands of requests
9Andem 3:48 am on Jun 28, 2012 (gmt 0)
newpost thread iconcache requests
 
1keyplyr 8:46 am on Jun 27, 2012 (gmt 0)
newpost thread iconFake user agent strings[2] ( 1 2 )
  How to recognize...
50grandma_genie 5:29 pm on Jun 26, 2012 (gmt 0)
newpost thread iconUser Agent Spam Attack
 
2incrediBILL 5:24 pm on Jun 26, 2012 (gmt 0)
newpost thread iconToolly Robot Used HTML User Agent String!
  What a Toolly
3incrediBILL 5:19 pm on Jun 26, 2012 (gmt 0)
newpost thread iconBot-Seeker
  hetzner hosting
2keyplyr 8:09 pm on Jun 23, 2012 (gmt 0)
newpost thread iconSmartLinksAddon
 
4wilderness 4:47 pm on Jun 21, 2012 (gmt 0)
newpost thread iconiPad
 
1wilderness 2:27 pm on Jun 21, 2012 (gmt 0)
newpost thread iconGoogle Site Verification Doesn't Take Rejection Well
 
5incrediBILL 9:31 pm on Jun 16, 2012 (gmt 0)
newpost thread iconPlaying Around With Bad Bots
 
11bakedjake 8:00 pm on Jun 15, 2012 (gmt 0)
newpost thread iconIPTelligent
  spam attempts
4keyplyr 6:27 pm on Jun 12, 2012 (gmt 0)
newpost thread iconMia research project bot
  spider@neofonie.de
3grandma_genie 8:52 pm on Jun 11, 2012 (gmt 0)
newpost thread iconUser agent switching
 
16btherl 6:05 pm on Jun 10, 2012 (gmt 0)
newpost thread iconDeninet Server Hosting
  hack attempts
1keyplyr 5:42 pm on Jun 9, 2012 (gmt 0)
newpost thread iconXL Internet Services
  hack attempts
3keyplyr 11:23 pm on Jun 8, 2012 (gmt 0)
newpost thread iconLoneStarBot Doesn't Honor Robots.txt
  Yippy Ki Yay
4incrediBILL 3:56 pm on Jun 7, 2012 (gmt 0)
newpost thread iconSingleHop
  hack attempts
7keyplyr 8:58 pm on Jun 6, 2012 (gmt 0)
newpost thread iconISPrime
  spam attempts
4keyplyr 7:41 pm on Jun 6, 2012 (gmt 0)
newpost thread iconbotnet with same user agent targeting specific pages
 
29wilderness 10:52 pm on Jun 5, 2012 (gmt 0)
Displaying Page 17 of 213<< Back 1 ... 7 8 9 10 11 12 13 14 15 16 [ 17 ] 18 19 20 21 22 23 24 25 26 ... 213 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved