homepage Welcome to WebmasterWorld Guest from 54.227.20.250
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconNekstbot
  New Polish Search Engine
6keyplyr 12:27 am on Jan 29, 2014 (gmt 0)
newpost thread iconTimestamp in useragent string?
 
8trintragula 11:19 pm on Jan 28, 2014 (gmt 0)
newpost thread iconAnybody have a clue
 
10wilderness 3:57 am on Jan 27, 2014 (gmt 0)
newpost thread iconmsnbot-media/1.1 generating a ton of 404s
  NONE existent JPEGs and GIFs
29blend27 9:41 pm on Jan 18, 2014 (gmt 0)
newpost thread iconDoes IP Range Block Via WHM Blacklist Block Same IP Ranges at cPanel
  Does IP Block at WHM BruteForce Level Filter Down to Unique Domains on VPS?
12Webwork 10:40 pm on Jan 14, 2014 (gmt 0)
newpost thread iconBRIC nations
  Eating Bricks
4Angonasec 7:27 am on Jan 13, 2014 (gmt 0)
newpost thread iconsputnik
 
6lucy24 7:52 pm on Jan 12, 2014 (gmt 0)
newpost thread iconZeerch
 
9Angonasec 6:30 pm on Jan 11, 2014 (gmt 0)
newpost thread iconRampant of Redmond
  Shivering my Timbers
7Angonasec 12:52 pm on Jan 10, 2014 (gmt 0)
newpost thread icon112.0.0.0/8
 
7keyplyr 9:43 pm on Jan 7, 2014 (gmt 0)
newpost thread iconUNTRUSTED in Nokia User Agent[2] ( 1 2 )
 
45lucy24 11:41 am on Jan 4, 2014 (gmt 0)
newpost thread iconthunderstone
  yes, them again
3lucy24 6:28 pm on Jan 1, 2014 (gmt 0)
newpost thread iconCome on Yahoo. Really?
 
7bobothecat2 8:38 pm on Dec 27, 2013 (gmt 0)
newpost thread iconwho's on 168?
 
1lucy24 3:10 am on Dec 22, 2013 (gmt 0)
newpost thread iconarchive.org bot
  bad bot
7keyplyr 7:20 am on Dec 20, 2013 (gmt 0)
newpost thread iconGoogle Test-Bot: Google-Test2
 
11doc_z 8:28 pm on Dec 19, 2013 (gmt 0)
newpost thread iconGoogle? Is that you?
 
13lucy24 10:33 pm on Dec 18, 2013 (gmt 0)
newpost thread iconIs there a Browser. . .
 
10wilderness 12:53 am on Dec 16, 2013 (gmt 0)
newpost thread iconTECH UPDATE: Javascript Makes Dumb Bots Obsolete
  Javascript Must Be Crawled For Scrapers To Survive
3incrediBILL 10:12 pm on Dec 15, 2013 (gmt 0)
newpost thread iconthe plainclothes bingbot
 
8lucy24 8:03 pm on Dec 14, 2013 (gmt 0)
newpost thread iconYahoo:LinkExpander:Slingstone
 
7keyplyr 2:06 pm on Dec 13, 2013 (gmt 0)
newpost thread iconGoogle Translate
 
7wilderness 2:43 am on Dec 11, 2013 (gmt 0)
newpost thread iconYaBrowser
 
15lucy24 10:04 am on Dec 10, 2013 (gmt 0)
newpost thread iconwscheck
 
1lucy24 1:17 am on Dec 10, 2013 (gmt 0)
newpost thread iconthis time it's Sogou
  61.135 returns
1lucy24 11:32 pm on Dec 9, 2013 (gmt 0)
Displaying Page 6 of 216<< Back 1 2 3 4 5 [ 6 ] 7 8 9 10 11 12 13 14 15 ... 216 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved