homepage Welcome to WebmasterWorld Guest from 54.211.95.201
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconMia research project bot
  spider@neofonie.de
3grandma_genie 8:52 pm on Jun 11, 2012 (gmt 0)
newpost thread iconUser agent switching
 
16btherl 6:05 pm on Jun 10, 2012 (gmt 0)
newpost thread iconDeninet Server Hosting
  hack attempts
1keyplyr 5:42 pm on Jun 9, 2012 (gmt 0)
newpost thread iconXL Internet Services
  hack attempts
3keyplyr 11:23 pm on Jun 8, 2012 (gmt 0)
newpost thread iconLoneStarBot Doesn't Honor Robots.txt
  Yippy Ki Yay
4incrediBILL 3:56 pm on Jun 7, 2012 (gmt 0)
newpost thread iconSingleHop
  hack attempts
7keyplyr 8:58 pm on Jun 6, 2012 (gmt 0)
newpost thread iconISPrime
  spam attempts
4keyplyr 7:41 pm on Jun 6, 2012 (gmt 0)
newpost thread iconbotnet with same user agent targeting specific pages
 
29wilderness 10:52 pm on Jun 5, 2012 (gmt 0)
newpost thread iconForum and Form spammer.
 
2g1smd 1:38 am on Jun 4, 2012 (gmt 0)
newpost thread iconcovert Microsoft crawl
 
6keyplyr 12:46 am on Jun 3, 2012 (gmt 0)
newpost thread iconNokia bad behaviour
  Is this a cloud, a bot or a proxy?
3dstiles 6:36 pm on Jun 2, 2012 (gmt 0)
newpost thread iconNew Blekkobot User Agent String
  scoutjet / blekkobot
11dstiles 9:04 pm on May 30, 2012 (gmt 0)
newpost thread iconBing plain clothes
  obnoxious pest
2Staffa 12:57 am on May 30, 2012 (gmt 0)
newpost thread iconSpider Forum Thread Titles
 
16incrediBILL 10:17 pm on May 29, 2012 (gmt 0)
newpost thread iconBad Spiders and Proxy Servers
  Using Opera Proxy
19grandma_genie 7:25 am on May 27, 2012 (gmt 0)
newpost thread iconHEAD request for favicon
  "Your favicon? What would it want with me?"
2lucy24 2:44 am on May 25, 2012 (gmt 0)
newpost thread iconYahoo Axis User Agent - Spotted One Yet?
 
1GaryK 7:29 pm on May 24, 2012 (gmt 0)
newpost thread iconurl include
 
12wilderness 8:40 pm on May 23, 2012 (gmt 0)
newpost thread icon"Capture Extractor" Botnet Crawling Observed
 
2incrediBILL 3:48 pm on May 23, 2012 (gmt 0)
newpost thread iconMalformed bingbot User Agent
  semi-colon missing
1g1smd 7:19 am on May 23, 2012 (gmt 0)
newpost thread iconInjection Attempt From Microlink IPs
 
4keyplyr 8:59 pm on May 22, 2012 (gmt 0)
newpost thread iconScrapers Using Peak Web Hosting and Generic Browser User Agents
 
4keyplyr 10:53 pm on May 19, 2012 (gmt 0)
newpost thread icondeny all
 
15wilderness 3:50 pm on May 14, 2012 (gmt 0)
newpost thread iconYahoo SE
 
2wilderness 1:46 pm on May 14, 2012 (gmt 0)
newpost thread iconBing blows a gasket
 
9wilderness 7:57 pm on May 13, 2012 (gmt 0)
Displaying Page 20 of 215<< Back 1 ... 10 11 12 13 14 15 16 17 18 19 [ 20 ] 21 22 23 24 25 26 27 28 29 ... 215 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved