Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| "Mozilla/5.0 ()" - Is this used by any valid browsers? |
7 | physics | 12:15 am Jan 19, 2015 | ||||
| Named distributed crawler list |
6 | trintragula | 11:03 am Jan 9, 2015 | ||||
| HTTP header fields ACCEPT and ACCEPT-CHARSET |
3 | dstiles | 5:01 pm Jan 8, 2015 | ||||
| Opera Mini IP ranges |
5 | Xpat | 5:22 pm Jan 7, 2015 | ||||
| Chinese exploiter out of Kansas City IP |
10 | slipkid | 6:34 am Jan 6, 2015 | ||||
| Bad Bot Blackhole - Blocking Ranges |
14 | SerpsGuy | 1:21 am Jan 1, 2015 | ||||
| Baidu UA |
5 | wilderness | 10:05 am Dec 31, 2014 | ||||
| VisiStat Misbehaving San Jose, CA Brat blocking itself |
3 | Hobbs | 10:01 am Dec 31, 2014 | ||||
| Google-Fake Directories testing 404 |
23 | wilderness | 5:10 am Dec 18, 2014 | ||||
| another one for the profilers [2] ( 1 2 ) |
38 | lucy24 | 3:30 am Dec 14, 2014 | ||||
| Ddos attack - what to do |
21 | doc_z | 12:37 pm Dec 13, 2014 | ||||
| Why so many China bots? |
13 | roshaoar | 11:57 pm Dec 8, 2014 | ||||
| NerdyBot and the Google Cloud Google range with strange referrer[2] ( 1 2 ) |
54 | dupres01 | 11:40 am Dec 5, 2014 | ||||
| PHP Vulnerability |
3 | wilderness | 10:09 am Nov 28, 2014 | ||||
| Invalid URI in request amobee-1 |
5 | yaashul | 7:33 pm Nov 27, 2014 | ||||
| Bots sharing info |
19 | roshaoar | 9:16 pm Nov 26, 2014 | ||||
| Strange UA |
16 | wilderness | 9:14 pm Nov 25, 2014 | ||||
| delay question |
3 | roshaoar | 5:02 pm Nov 24, 2014 | ||||
| Gb of Bandwidth for 403s Bandwidth over the limit once a day |
10 | not2easy | 3:32 pm Nov 24, 2014 | ||||
| double agents? |
4 | lucy24 | 4:16 am Nov 10, 2014 | ||||
| Microsoft Insitesbot |
7 | Hobbs | 6:00 pm Nov 8, 2014 | ||||
| Strange Mobile Visits. |
12 | bobothecat2 | 7:44 pm Oct 19, 2014 | ||||
| What do we do with all the IP blocks gathered? What technology to block crawlers, .htaccess or scripts? |
22 | dougwilson | 7:06 pm Oct 15, 2014 | ||||
| WebTarantula Tools They have their own nasty browser, toolbar, and bots |
9 | Angonasec | 7:11 pm Oct 12, 2014 | ||||
| stremorbot |
7 | wilderness | 10:14 am Oct 6, 2014 |
