homepage Welcome to WebmasterWorld Guest from 54.237.95.6
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconMore Chinanet[2] ( 1 2 )
  119.128.0.0
36not2easy 7:29 pm on Nov 26, 2012 (gmt 0)
newpost thread iconphoney Hungarian bingbot
  UA claims bingbot
1dupres01 6:14 pm on Nov 26, 2012 (gmt 0)
newpost thread iconGET Request
 
6Ken_S 10:03 pm on Nov 25, 2012 (gmt 0)
newpost thread icon76.74.153.xx
  no robots.txt , blank user agent
10Bewenched 8:21 pm on Nov 25, 2012 (gmt 0)
newpost thread iconOngoing ia archiver Abuse From China
 
4incrediBILL 6:52 pm on Nov 25, 2012 (gmt 0)
newpost thread iconAttemped hacker
  out of an aol range
1Bewenched 5:57 pm on Nov 25, 2012 (gmt 0)
newpost thread iconGumGum Bot
  107.22.108.63
1Bewenched 8:08 am on Nov 25, 2012 (gmt 0)
newpost thread iconfilterdb.iss.net/crawler/
  194.153.113.35
6Bewenched 11:38 pm on Nov 24, 2012 (gmt 0)
newpost thread iconFake Google or code.google.com ?
  89.164.163.72
8Bewenched 10:35 pm on Nov 24, 2012 (gmt 0)
newpost thread iconSpinn3r+3.1
  174.36.228.xxx
2Bewenched 9:14 pm on Nov 24, 2012 (gmt 0)
newpost thread iconMailru-net
  stopped by snagging images only.
8Bewenched 9:48 pm on Nov 22, 2012 (gmt 0)
newpost thread iconNetherlands blank user agent
  213.206.102.103
1Bewenched 8:37 am on Nov 22, 2012 (gmt 0)
newpost thread iconPixray-Seeker
  81.30.151.218
1Bewenched 8:33 am on Nov 22, 2012 (gmt 0)
newpost thread iconAnother odd google user agent
  66.249.75.21
1Bewenched 8:32 am on Nov 22, 2012 (gmt 0)
newpost thread iconGoogle crawling as an iphone
  66.249.75.21
1Bewenched 8:19 am on Nov 22, 2012 (gmt 0)
newpost thread iconData Foundry
 
2keyplyr 6:40 am on Nov 21, 2012 (gmt 0)
newpost thread iconRequest for same image via various wireless networks
  Mozilla/4.0, No-Referrer, Repeated 1-3 image requests
5mslina2002 3:14 am on Nov 21, 2012 (gmt 0)
newpost thread iconheaders check
 
10wilderness 12:56 am on Nov 21, 2012 (gmt 0)
newpost thread iconNobis/Ubiquity
 
4keyplyr 12:12 am on Nov 21, 2012 (gmt 0)
newpost thread iconwhat's wrong with UA
  suspicious UA
6dupres01 2:48 pm on Nov 18, 2012 (gmt 0)
newpost thread iconHiChina
 
5keyplyr 3:37 am on Nov 18, 2012 (gmt 0)
newpost thread iconBeetleBot
  188.207.200.116
6Bewenched 1:47 am on Nov 18, 2012 (gmt 0)
newpost thread iconBingbot with one domain and two IPs
  What's the point of that?
10moTi 3:18 am on Nov 16, 2012 (gmt 0)
newpost thread iconCompSpyBot
  68.47.129.55
8Bewenched 9:51 pm on Nov 15, 2012 (gmt 0)
newpost thread iconadbeat.com
  174.129.111.51
2Bewenched 10:48 pm on Nov 14, 2012 (gmt 0)
Displaying Page 10 of 213<< Back 1 2 3 4 5 6 7 8 9 [ 10 ] 11 12 13 14 15 16 17 18 19 ... 213 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved