homepage Welcome to WebmasterWorld Guest from 54.161.185.244
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconyahoo? Is that you?
 
21lucy24 9:46 am on Feb 6, 2014 (gmt 0)
newpost thread iconGooglebot-Mobile User Agent To Retire For Smartphones
 
3engine 8:15 pm on Feb 5, 2014 (gmt 0)
newpost thread iconTarget Domain in Useragent string
  new to me
4trintragula 12:31 pm on Feb 3, 2014 (gmt 0)
newpost thread iconDo Cell Phone Companies Notify DNSBLs?
  I don't think they do.
7incrediBILL 3:44 am on Feb 2, 2014 (gmt 0)
newpost thread iconarchive.is
 
4wilderness 3:24 am on Feb 2, 2014 (gmt 0)
newpost thread iconGoogle IPs Cannot Be Trusted
  Only Googlebot With Round-Trip DNS Validation
12incrediBILL 10:55 am on Jan 31, 2014 (gmt 0)
newpost thread iconWordPress Comment Spam Escalation[2] ( 1 2 )
  Simple SpamBot Blocking Stops Massive Spamming Attack
46incrediBILL 9:39 am on Jan 31, 2014 (gmt 0)
newpost thread iconTo Block or Not To Block That is The Question
  block bots block ua
11EastTexas 12:44 am on Jan 29, 2014 (gmt 0)
newpost thread iconNekstbot
  New Polish Search Engine
6keyplyr 12:27 am on Jan 29, 2014 (gmt 0)
newpost thread iconTimestamp in useragent string?
 
8trintragula 11:19 pm on Jan 28, 2014 (gmt 0)
newpost thread iconAnybody have a clue
 
10wilderness 3:57 am on Jan 27, 2014 (gmt 0)
newpost thread iconmsnbot-media/1.1 generating a ton of 404s
  NONE existent JPEGs and GIFs
29blend27 9:41 pm on Jan 18, 2014 (gmt 0)
newpost thread iconDoes IP Range Block Via WHM Blacklist Block Same IP Ranges at cPanel
  Does IP Block at WHM BruteForce Level Filter Down to Unique Domains on VPS?
12Webwork 10:40 pm on Jan 14, 2014 (gmt 0)
newpost thread iconBRIC nations
  Eating Bricks
4Angonasec 7:27 am on Jan 13, 2014 (gmt 0)
newpost thread iconsputnik
 
6lucy24 7:52 pm on Jan 12, 2014 (gmt 0)
newpost thread iconZeerch
 
9Angonasec 6:30 pm on Jan 11, 2014 (gmt 0)
newpost thread iconRampant of Redmond
  Shivering my Timbers
7Angonasec 12:52 pm on Jan 10, 2014 (gmt 0)
newpost thread icon112.0.0.0/8
 
7keyplyr 9:43 pm on Jan 7, 2014 (gmt 0)
newpost thread iconUNTRUSTED in Nokia User Agent[2] ( 1 2 )
 
45lucy24 11:41 am on Jan 4, 2014 (gmt 0)
newpost thread iconthunderstone
  yes, them again
3lucy24 6:28 pm on Jan 1, 2014 (gmt 0)
newpost thread iconCome on Yahoo. Really?
 
7bobothecat2 8:38 pm on Dec 27, 2013 (gmt 0)
newpost thread iconwho's on 168?
 
1lucy24 3:10 am on Dec 22, 2013 (gmt 0)
newpost thread iconarchive.org bot
  bad bot
7keyplyr 7:20 am on Dec 20, 2013 (gmt 0)
newpost thread iconGoogle Test-Bot: Google-Test2
 
11doc_z 8:28 pm on Dec 19, 2013 (gmt 0)
newpost thread iconGoogle? Is that you?
 
13lucy24 10:33 pm on Dec 18, 2013 (gmt 0)
Displaying Page 6 of 216<< Back 1 2 3 4 5 [ 6 ] 7 8 9 10 11 12 13 14 15 ... 216 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved