homepage Welcome to WebmasterWorld Guest from 54.205.254.108
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconGooglebot iPhone User Agent
 
9lucy24 1:19 pm on Feb 17, 2014 (gmt 0)
newpost thread iconapplewebkit/534.30 (khtml like gecko) Real or fake?
 
4jbrohit 7:38 pm on Feb 16, 2014 (gmt 0)
newpost thread iconFieldtech?
 
9lucy24 10:58 pm on Feb 13, 2014 (gmt 0)
newpost thread iconGoogle proxy favicon hits
 
1dstiles 7:44 pm on Feb 12, 2014 (gmt 0)
newpost thread iconThe Whitelist[3] ( 1 2 3 )
  Key Elements
86tangor 11:37 am on Feb 12, 2014 (gmt 0)
newpost thread iconServer Farms - Sept. 2013[11] ( 1 2 3 4 5 6 7 8 9 10 11 )
  Ongoing Hosting Data Center Discussion
327incrediBILL 12:22 pm on Feb 7, 2014 (gmt 0)
newpost thread iconyahoo? Is that you?
 
21lucy24 9:46 am on Feb 6, 2014 (gmt 0)
newpost thread iconGooglebot-Mobile User Agent To Retire For Smartphones
 
3engine 8:15 pm on Feb 5, 2014 (gmt 0)
newpost thread iconTarget Domain in Useragent string
  new to me
4trintragula 12:31 pm on Feb 3, 2014 (gmt 0)
newpost thread iconDo Cell Phone Companies Notify DNSBLs?
  I don't think they do.
7incrediBILL 3:44 am on Feb 2, 2014 (gmt 0)
newpost thread iconarchive.is
 
4wilderness 3:24 am on Feb 2, 2014 (gmt 0)
newpost thread iconGoogle IPs Cannot Be Trusted
  Only Googlebot With Round-Trip DNS Validation
12incrediBILL 10:55 am on Jan 31, 2014 (gmt 0)
newpost thread iconWordPress Comment Spam Escalation[2] ( 1 2 )
  Simple SpamBot Blocking Stops Massive Spamming Attack
46incrediBILL 9:39 am on Jan 31, 2014 (gmt 0)
newpost thread iconTo Block or Not To Block That is The Question
  block bots block ua
11EastTexas 12:44 am on Jan 29, 2014 (gmt 0)
newpost thread iconNekstbot
  New Polish Search Engine
6keyplyr 12:27 am on Jan 29, 2014 (gmt 0)
newpost thread iconTimestamp in useragent string?
 
8trintragula 11:19 pm on Jan 28, 2014 (gmt 0)
newpost thread iconAnybody have a clue
 
10wilderness 3:57 am on Jan 27, 2014 (gmt 0)
newpost thread iconmsnbot-media/1.1 generating a ton of 404s
  NONE existent JPEGs and GIFs
29blend27 9:41 pm on Jan 18, 2014 (gmt 0)
newpost thread iconDoes IP Range Block Via WHM Blacklist Block Same IP Ranges at cPanel
  Does IP Block at WHM BruteForce Level Filter Down to Unique Domains on VPS?
12Webwork 10:40 pm on Jan 14, 2014 (gmt 0)
newpost thread iconBRIC nations
  Eating Bricks
4Angonasec 7:27 am on Jan 13, 2014 (gmt 0)
newpost thread iconsputnik
 
6lucy24 7:52 pm on Jan 12, 2014 (gmt 0)
newpost thread iconZeerch
 
9Angonasec 6:30 pm on Jan 11, 2014 (gmt 0)
newpost thread iconRampant of Redmond
  Shivering my Timbers
7Angonasec 12:52 pm on Jan 10, 2014 (gmt 0)
newpost thread icon112.0.0.0/8
 
7keyplyr 9:43 pm on Jan 7, 2014 (gmt 0)
newpost thread iconUNTRUSTED in Nokia User Agent[2] ( 1 2 )
 
45lucy24 11:41 am on Jan 4, 2014 (gmt 0)
Displaying Page 5 of 215<< Back 1 2 3 4 [ 5 ] 6 7 8 9 10 11 12 13 14 ... 215 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved