Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| MaxPointCrawler |
5 | keyplyr | 10:47 am Oct 12, 2015 | ||||
| SurdotlyBot |
12 | keyplyr | 10:59 am Oct 11, 2015 | ||||
| best-seo-solution Hello semalt, my old friend[3] ( 1 2 3 ) |
61 | Pfui | 4:29 am Oct 9, 2015 | ||||
| StashBot |
3 | keyplyr | 1:22 am Oct 9, 2015 | ||||
| Google favicon [2] ( 1 2 ) |
54 | keyplyr | 8:50 am Oct 7, 2015 | ||||
| OpenHoseBot |
6 | keyplyr | 6:15 pm Oct 5, 2015 | ||||
| unknown |
11 | keyplyr | 2:49 pm Oct 5, 2015 | ||||
| Crazywebcrawler |
3 | keyplyr | 11:07 pm Oct 2, 2015 | ||||
| ICAP-IOD ua |
6 | LordSilver | 9:17 pm Sept 29, 2015 | ||||
| Kaywa nostat |
4 | keyplyr | 9:44 pm Sept 22, 2015 | ||||
| Dorado WAP-Browser |
3 | keyplyr | 9:08 pm Sept 22, 2015 | ||||
| AdlesseBot |
5 | keyplyr | 9:35 am Sept 18, 2015 | ||||
| Blue Coat |
3 | lucy24 | 8:19 am Sept 16, 2015 | ||||
| Adblock Browser for Android |
25 | keyplyr | 6:11 pm Sept 15, 2015 | ||||
| Go 1.1 package http |
19 | keyplyr | 1:10 pm Sept 14, 2015 | ||||
| other people's cookies |
8 | lucy24 | 1:56 am Sept 13, 2015 | ||||
| the oBot returns |
6 | lucy24 | 6:50 pm Sept 10, 2015 | ||||
| Riddler |
7 | keyplyr | 1:51 am Sept 8, 2015 | ||||
| Puffin |
9 | lucy24 | 9:27 pm Sept 7, 2015 | ||||
| Mysterious User Agents |
6 | wilderness | 2:46 am Sept 7, 2015 | ||||
| 'compatible' |
8 | wilderness | 7:52 pm Sept 5, 2015 | ||||
| Block ALL bots except google Looking for the best way to block all bots/crawlers other than google. |
18 | classicman | 5:07 pm Sept 5, 2015 | ||||
| Long referers |
6 | dstiles | 6:42 pm Sept 4, 2015 | ||||
| Arachnida a spider by any other name |
4 | lucy24 | 10:35 am Aug 31, 2015 | ||||
| MSOffice |
7 | keyplyr | 4:06 pm Aug 30, 2015 |
