Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| ShapBot/0.1.0 104.154.193.69 |
2 | Bewenched | 3:15 am Aug 30, 2025 | ||||
| TikTokSpider - crashed our server 47.128.121.68 |
7 | Bewenched | 12:23 am Aug 20, 2025 | ||||
| What is WordPress user agent? Showing up in visitor logs |
17 | MichaelBluejay | 5:08 am Aug 12, 2025 | ||||
| Seeing a lot more activity from applebot lately |
3 | SumGuy | 6:05 am Aug 2, 2025 | ||||
| Search engines choking on phpBB |
13 | Kendo | 12:57 pm Jul 27, 2025 | ||||
| Gemini-Deep-Research |
1 | SumGuy | 5:34 am Jul 7, 2025 | ||||
| Brightbot |
2 | lucy24 | 5:25 am Jul 7, 2025 | ||||
| Best method to block unwanted visits via Cpanel Site is routinely being overwhelmed with UAs(?) I don't care about |
6 | millimi1 | 10:40 am Jun 28, 2025 | ||||
| GoogleBot Spoofer 112.121.172.18 |
2 | Bewenched | 6:16 pm Jun 22, 2025 | ||||
| Ping probe from Anthropic IP |
4 | SumGuy | 12:00 am Jun 22, 2025 | ||||
| Softbank Data center or ISP? |
1 | SumGuy | 11:53 am Jun 12, 2025 | ||||
| Referer = www . baidu . com I flag these as bot/VPN |
2 | SumGuy | 4:05 am Jun 5, 2025 | ||||
| GIGENET - bot run wild 63.141.52.0/22 |
3 | Bewenched | 12:17 am Jun 5, 2025 | ||||
| AmazonBot ignoring robots.txt 3.208.0.0/12 |
2 | Bewenched | 10:59 pm Jun 4, 2025 | ||||
| SuperFastScraper/2.0 showed up today |
1 | SumGuy | 1:16 am Jun 3, 2025 | ||||
| Clickagy Intelligence Bot v3 100.27.30.79 |
2 | Bewenched | 4:20 pm Jun 1, 2025 | ||||
| Alibaba Cloud Computing - Scraper? Alibaba Cloud LLC (AL-3) |
2 | Bewenched | 10:36 am Jun 1, 2025 | ||||
| Claudebot (Anthropic) and "RandomBot" New bots for me |
2 | SumGuy | 5:05 pm May 26, 2025 | ||||
| Can you spot the difference? |
13 | lucy24 | 4:15 pm May 25, 2025 | ||||
| Starlink ISP odd visit - tripped bot trap 98.97.42.160 |
7 | Bewenched | 6:15 am May 19, 2025 | ||||
| wpbot |
7 | ryoko | 3:28 pm May 16, 2025 | ||||
| Perfect International, Inc - Massive hack attempt 70.36.96.0/19 |
2 | Bewenched | 7:35 pm Apr 30, 2025 | ||||
| X11; Linux x86 64 Do you see this UA much? When you do, is it legit? |
6 | SumGuy | 4:47 pm Apr 25, 2025 | ||||
| undici redux up to eleven |
3 | lucy24 | 1:30 am Apr 22, 2025 | ||||
| Orbbot |
3 | ryoko | 5:31 pm Apr 20, 2025 |
