Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Corax |
3 | tangor | 6:02 pm Dec 7, 2019 | ||||
| Bot Mashing |
5 | rivsrush | 2:00 pm Dec 6, 2019 | ||||
| Linespider |
9 | lucy24 | 11:16 am Nov 21, 2019 | ||||
| Any humans come from there? *.compute.hwclouds-dns.com |
4 | blend27 | 6:02 am Nov 17, 2019 | ||||
| ApiTool |
7 | Pfui | 2:26 am Nov 17, 2019 | ||||
| Python, Curl and Robots.txt |
17 | dstiles | 8:48 pm Nov 12, 2019 | ||||
| whisper |
14 | lucy24 | 10:00 am Oct 20, 2019 | ||||
| Return / continuation of msnbot search.msn.com/msnbot.html |
11 | dstiles | 9:58 am Oct 20, 2019 | ||||
| Google hiccup |
3 | wilderness | 9:33 am Oct 14, 2019 | ||||
| Hi Pages exploit UA |
15 | Pfui | 5:26 am Oct 5, 2019 | ||||
| URI: ./ ./ mnt/ custom/ ProductDefinition DVR remote code execution |
3 | Pfui | 5:35 pm Sep 27, 2019 | ||||
| Yisou again |
2 | lucy24 | 12:06 am Sep 27, 2019 | ||||
| GrumpyCrawler Microsoft range |
3 | Pfui | 6:02 pm Sep 24, 2019 | ||||
| Mb2345Browser/9.0 I'm pretty sure this is actually a crawler, not a browser |
8 | notriddle | 2:51 am Sep 10, 2019 | ||||
| serpstatbot/1.0 (advanced backlink tracking bot |
3 | notriddle | 9:28 pm Sep 3, 2019 | ||||
| Moreover |
4 | lucy24 | 1:18 am Sep 2, 2019 | ||||
| BingPreview from Facebook |
4 | lucy24 | 8:50 pm Sep 1, 2019 | ||||
| GoogleImageProxy redux; runs amok |
9 | Pfui | 11:22 am Aug 30, 2019 | ||||
| looid.com Search Engine |
3 | Pfui | 4:54 am Aug 29, 2019 | ||||
| Plague of Viewbots help on how to detect view bots? |
12 | PeachyCheech | 8:47 pm Aug 22, 2019 | ||||
| Looking at some strange hits from Microsoft IP's Some are from outlook outbound mail servers? |
2 | SumGuy | 6:27 am Aug 21, 2019 | ||||
| Firefox on Mac User-agent -> version number is 4-digit hex value Seeing coordinated bot activity |
4 | SumGuy | 1:38 am Aug 16, 2019 | ||||
| User Agent cdnposUserAgentcdnpos<> 3.224.211.xxx |
2 | Bewenched | 8:22 pm Aug 13, 2019 | ||||
| Seeing hits from 3.0.0.0/8 for first time Is Amazon |
9 | SumGuy | 7:15 pm Aug 13, 2019 | ||||
| Bad Bot hack attempts 23.83.128.0/21 |
5 | Bewenched | 5:45 pm Aug 13, 2019 |
