homepage Welcome to WebmasterWorld Guest from 54.146.143.102
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconScreenerBot
 
3Ocean10000 8:28 pm on Apr 10, 2013 (gmt 0)
newpost thread iconFake BingBot[2] ( 1 2 )
  1000s of hits from a Slicehost IP
31Gaia 9:29 pm on Apr 3, 2013 (gmt 0)
newpost thread iconfacebookexternalhit - Accessing /images/ now?
 
7brokaddr 9:36 pm on Mar 28, 2013 (gmt 0)
newpost thread iconAre there ANY legitimate visits from AWS?
 
151script 6:30 pm on Mar 27, 2013 (gmt 0)
newpost thread iconDetecting human users via user agent
  Not looking for 100% accuracy, close enough will do
6bhonda 2:27 am on Mar 25, 2013 (gmt 0)
newpost thread iconmsresearch.us
  cloaked MSN spawn
3Pfui 3:25 am on Mar 21, 2013 (gmt 0)
newpost thread iconStatic IP Services
 
4wilderness 1:43 pm on Mar 18, 2013 (gmt 0)
newpost thread iconServer Farms, Elron Technologies and more[6] ( 1 2 3 4 5 6 )
 
169wilderness 12:24 am on Mar 8, 2013 (gmt 0)
newpost thread iconTemporary Absence Update
 
8incrediBILL 1:57 am on Mar 6, 2013 (gmt 0)
newpost thread iconRevised Spider IPs and Other Details
  At Home with the Robots: 2013 edition
6lucy24 5:08 pm on Mar 3, 2013 (gmt 0)
newpost thread iconFacebook
 
2topr8 8:20 am on Feb 27, 2013 (gmt 0)
newpost thread iconSoftlayer
 
13Ken_S 9:43 pm on Feb 21, 2013 (gmt 0)
newpost thread iconPinterest Domain Verifier
 
6keyplyr 11:50 pm on Feb 20, 2013 (gmt 0)
newpost thread iconanother day, another translation
 
1lucy24 6:46 am on Feb 19, 2013 (gmt 0)
newpost thread iconBlekko how to ban
 
5viggen 12:41 am on Feb 17, 2013 (gmt 0)
newpost thread iconmsnbot-media[2] ( 1 2 )
  What's a nice robot like you doing in a place like this?
58lucy24 4:25 am on Feb 12, 2013 (gmt 0)
newpost thread icon-very- much the same robot
 
10lucy24 10:48 pm on Feb 4, 2013 (gmt 0)
newpost thread iconU of Cal
  Santa Barbara
9wilderness 11:19 am on Feb 4, 2013 (gmt 0)
newpost thread iconBingBot Fake
 
19Ken_S 3:45 am on Feb 4, 2013 (gmt 0)
newpost thread iconYandex gets fatter
 
13lucy24 9:57 pm on Feb 1, 2013 (gmt 0)
newpost thread iconthe latest impenetrable disguise[2] ( 1 2 )
 
40lucy24 3:47 am on Jan 30, 2013 (gmt 0)
newpost thread icongoo goo GET GET
 
8lucy24 7:50 am on Jan 27, 2013 (gmt 0)
newpost thread iconFiltering Out Really Hard To Find Bad Bots
 
26incrediBILL 2:16 am on Jan 24, 2013 (gmt 0)
newpost thread iconZTE-Z431/1.4.0 NetFront/4.2 QTV5.1 User-Agent
  Profile/MIDP-2.1 Configuration/CLDC-1.1
4not2easy 9:24 pm on Jan 23, 2013 (gmt 0)
newpost thread iconstrange g-refers
 
1wilderness 5:41 pm on Jan 22, 2013 (gmt 0)
Displaying Page 11 of 217<< Back 1 2 3 4 5 6 7 8 9 10 [ 11 ] 12 13 14 15 16 17 18 19 20 ... 217 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved