homepage Welcome to WebmasterWorld Guest from 54.197.92.233
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconStrange Googlebot behavior
  Grabbing same page over and over in one hit
7grandma_genie 4:57 pm on May 31, 2013 (gmt 0)
newpost thread iconoBot robot where art thou?
 
5lucy24 9:16 pm on May 30, 2013 (gmt 0)
newpost thread iconIANA Country Codes
  No longer published as country codes?
10dstiles 9:22 pm on May 27, 2013 (gmt 0)
newpost thread iconNeedle
  Ouch, here is a thread for you.
11blend27 9:19 pm on May 27, 2013 (gmt 0)
newpost thread iconRackspace
  198.61.128.0 - 198.61.255.255
7Bewenched 9:18 pm on May 27, 2013 (gmt 0)
newpost thread icontrue.net business internet or hosting?
 
7incrediBILL 7:18 pm on May 17, 2013 (gmt 0)
newpost thread iconabove the law? ignores ROBOTS.TXT
 
13lucy24 10:41 am on May 17, 2013 (gmt 0)
newpost thread iconAmazon AWS Hosts Bad Bots[3] ( 1 2 3 )
  amazonaws.com
88Pfui 11:07 pm on May 16, 2013 (gmt 0)
newpost thread iconAcoonBot (Leaseweb Germany)
  37.58.52.15
7Bewenched 9:44 pm on May 12, 2013 (gmt 0)
newpost thread iconCyberbunker
 
9keyplyr 7:00 am on May 11, 2013 (gmt 0)
newpost thread iconFirefox Browser just passing through
 
3lucy24 6:50 pm on May 8, 2013 (gmt 0)
newpost thread iconWotbox/2.0 is cheating from DSL hosting
  Contains unauthorized content
2incrediBILL 8:18 pm on May 6, 2013 (gmt 0)
newpost thread iconServer Farms - March 2013[4] ( 1 2 3 4 )
  Ongoing WMW server farm report
92wilderness 8:15 pm on May 5, 2013 (gmt 0)
newpost thread iconDon't stop fearing the webreaper
 
6lucy24 7:53 pm on May 4, 2013 (gmt 0)
newpost thread iconIpod, Ipad Iphone user agents
  Any bad conduct coming from such UAs
3slipkid 3:12 am on May 3, 2013 (gmt 0)
newpost thread iconBritish Library bot
  UK law now requires British Library to harvest UK web sites.
3dstiles 1:56 pm on May 1, 2013 (gmt 0)
newpost thread iconHow Blocking Impacts Traffic and Other Web Services
 
2incrediBILL 8:02 pm on Apr 30, 2013 (gmt 0)
newpost thread iconstremorbot
 
15lucy24 5:51 pm on Apr 22, 2013 (gmt 0)
newpost thread iconhosting company out of Japan
  203.189.109.108
3Bewenched 3:53 am on Apr 19, 2013 (gmt 0)
newpost thread iconwho are piclab and what do they want with us?
 
4lucy24 2:31 am on Apr 19, 2013 (gmt 0)
newpost thread iconchecks.panopta.com User Agent
  Another site monitor
16grandma_genie 1:52 pm on Apr 16, 2013 (gmt 0)
newpost thread iconip-web-crawler - stupidity never goes out of fashion
 
8lucy24 8:54 pm on Apr 10, 2013 (gmt 0)
newpost thread iconScreenerBot
 
3Ocean10000 8:28 pm on Apr 10, 2013 (gmt 0)
newpost thread iconFake BingBot[2] ( 1 2 )
  1000s of hits from a Slicehost IP
31Gaia 9:29 pm on Apr 3, 2013 (gmt 0)
newpost thread iconfacebookexternalhit - Accessing /images/ now?
 
7brokaddr 9:36 pm on Mar 28, 2013 (gmt 0)
Displaying Page 10 of 216<< Back 1 2 3 4 5 6 7 8 9 [ 10 ] 11 12 13 14 15 16 17 18 19 ... 216 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved