Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
  Chinese exploiter out of Kansas City IP
10 slipkid 6:34 am Jan 6, 2015
  Bad Bot Blackhole - Blocking Ranges
14 SerpsGuy 1:21 am Jan 1, 2015
  Baidu UA
5 wilderness 10:05 am Dec 31, 2014
  VisiStat
Misbehaving San Jose, CA Brat blocking itself
3 Hobbs 10:01 am Dec 31, 2014
  Google-Fake Directories testing 404
23 wilderness 5:10 am Dec 18, 2014
  another one for the profilers
[2] ( 1 2 )
38 lucy24 3:30 am Dec 14, 2014
  Ddos attack - what to do
21 doc_z 12:37 pm Dec 13, 2014
  Why so many China bots?
13 roshaoar 11:57 pm Dec 8, 2014
  NerdyBot and the Google Cloud
Google range with strange referrer[2] ( 1 2 )
54 dupres01 11:40 am Dec 5, 2014
  PHP Vulnerability
3 wilderness 10:09 am Nov 28, 2014
  Invalid URI in request amobee-1
5 yaashul 7:33 pm Nov 27, 2014
  Bots sharing info
19 roshaoar 9:16 pm Nov 26, 2014
  Strange UA
16 wilderness 9:14 pm Nov 25, 2014
  delay question
3 roshaoar 5:02 pm Nov 24, 2014
  Gb of Bandwidth for 403s
Bandwidth over the limit once a day
10 not2easy 3:32 pm Nov 24, 2014
  double agents?
4 lucy24 4:16 am Nov 10, 2014
  Microsoft Insitesbot
7 Hobbs 6:00 pm Nov 8, 2014
  Strange Mobile Visits.
12 bobothecat2 7:44 pm Oct 19, 2014
  What do we do with all the IP blocks gathered?
What technology to block crawlers, .htaccess or scripts?
22 dougwilson 7:06 pm Oct 15, 2014
  WebTarantula Tools
They have their own nasty browser, toolbar, and bots
9 Angonasec 7:11 pm Oct 12, 2014
  stremorbot
7 wilderness 10:14 am Oct 6, 2014
  141 Class A
5 wilderness 1:13 am Oct 6, 2014
  Don't understand this log entry
15 aristotle 10:36 am Sept 21, 2014
  ContextAdbot IP updates
6 lucy24 1:31 am Sept 3, 2014
  GTT bots
You may want to fine tune your blocks: I don't
5 Angonasec 12:22 pm Aug 27, 2014