Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| OpenHoseBot |
6 | keyplyr | 6:15 pm Oct 5, 2015 | ||||
| unknown |
11 | keyplyr | 2:49 pm Oct 5, 2015 | ||||
| Crazywebcrawler |
3 | keyplyr | 11:07 pm Oct 2, 2015 | ||||
| ICAP-IOD ua |
6 | LordSilver | 9:17 pm Sept 29, 2015 | ||||
| Kaywa nostat |
4 | keyplyr | 9:44 pm Sept 22, 2015 | ||||
| Dorado WAP-Browser |
3 | keyplyr | 9:08 pm Sept 22, 2015 | ||||
| AdlesseBot |
5 | keyplyr | 9:35 am Sept 18, 2015 | ||||
| Blue Coat |
3 | lucy24 | 8:19 am Sept 16, 2015 | ||||
| Adblock Browser for Android |
25 | keyplyr | 6:11 pm Sept 15, 2015 | ||||
| Go 1.1 package http |
19 | keyplyr | 1:10 pm Sept 14, 2015 | ||||
| other people's cookies |
8 | lucy24 | 1:56 am Sept 13, 2015 | ||||
| the oBot returns |
6 | lucy24 | 6:50 pm Sept 10, 2015 | ||||
| Riddler |
7 | keyplyr | 1:51 am Sept 8, 2015 | ||||
| Puffin |
9 | lucy24 | 9:27 pm Sept 7, 2015 | ||||
| Mysterious User Agents |
6 | wilderness | 2:46 am Sept 7, 2015 | ||||
| 'compatible' |
8 | wilderness | 7:52 pm Sept 5, 2015 | ||||
| Block ALL bots except google Looking for the best way to block all bots/crawlers other than google. |
18 | classicman | 5:07 pm Sept 5, 2015 | ||||
| Long referers |
6 | dstiles | 6:42 pm Sept 4, 2015 | ||||
| Arachnida a spider by any other name |
4 | lucy24 | 10:35 am Aug 31, 2015 | ||||
| MSOffice |
7 | keyplyr | 4:06 pm Aug 30, 2015 | ||||
| GozaikBot |
6 | keyplyr | 8:49 am Aug 29, 2015 | ||||
| OrangeBot |
3 | keyplyr | 7:53 pm Aug 25, 2015 | ||||
| New Updated Googlebot Smartphone UA |
2 | engine | 6:09 pm Aug 21, 2015 | ||||
| Scopia Crawler |
7 | keyplyr | 6:05 pm Aug 21, 2015 | ||||
| Web crawler humor time to have a little fun |
9 | incrediBILL | 10:45 pm Aug 19, 2015 |
