Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| GoogleBot Spoofer 112.121.172.18 |
2 | Bewenched | 6:16 pm Jun 22, 2025 | ||||
| Ping probe from Anthropic IP |
4 | SumGuy | 12:00 am Jun 22, 2025 | ||||
| Softbank Data center or ISP? |
1 | SumGuy | 11:53 am Jun 12, 2025 | ||||
| Referer = www . baidu . com I flag these as bot/VPN |
2 | SumGuy | 4:05 am Jun 5, 2025 | ||||
| GIGENET - bot run wild 63.141.52.0/22 |
3 | Bewenched | 12:17 am Jun 5, 2025 | ||||
| AmazonBot ignoring robots.txt 3.208.0.0/12 |
2 | Bewenched | 10:59 pm Jun 4, 2025 | ||||
| SuperFastScraper/2.0 showed up today |
1 | SumGuy | 1:16 am Jun 3, 2025 | ||||
| Clickagy Intelligence Bot v3 100.27.30.79 |
2 | Bewenched | 4:20 pm Jun 1, 2025 | ||||
| Alibaba Cloud Computing - Scraper? Alibaba Cloud LLC (AL-3) |
2 | Bewenched | 10:36 am Jun 1, 2025 | ||||
| Claudebot (Anthropic) and "RandomBot" New bots for me |
2 | SumGuy | 5:05 pm May 26, 2025 | ||||
| Can you spot the difference? |
13 | lucy24 | 4:15 pm May 25, 2025 | ||||
| Starlink ISP odd visit - tripped bot trap 98.97.42.160 |
7 | Bewenched | 6:15 am May 19, 2025 | ||||
| wpbot |
7 | ryoko | 3:28 pm May 16, 2025 | ||||
| Perfect International, Inc - Massive hack attempt 70.36.96.0/19 |
2 | Bewenched | 7:35 pm Apr 30, 2025 | ||||
| X11; Linux x86 64 Do you see this UA much? When you do, is it legit? |
6 | SumGuy | 4:47 pm Apr 25, 2025 | ||||
| undici redux up to eleven |
3 | lucy24 | 1:30 am Apr 22, 2025 | ||||
| Orbbot |
3 | ryoko | 5:31 pm Apr 20, 2025 | ||||
| Barkrowler (babbar.tech/crawler) What do we know about it? |
3 | SumGuy | 5:14 pm Apr 13, 2025 | ||||
| AI bots |
20 | Scooter24 | 2:14 am Apr 11, 2025 | ||||
| iPhone user-agents (with Chrome) Are these legit? |
1 | SumGuy | 11:54 pm Mar 21, 2025 | ||||
| Overview of OpenAI Crawlers |
2 | engine | 12:55 pm Mar 13, 2025 | ||||
| Kitties and Gentelmen Lets start a new Server-Farms thread! |
5 | blend27 | 2:05 pm Feb 27, 2025 | ||||
| Turkey News Feed? useragent "newspaper/0.2.8" |
5 | ghostofseo | 3:33 am Feb 11, 2025 | ||||
| Google Bot operating from 192.178.6.0/24 Something new? |
2 | SumGuy | 6:11 pm Jan 23, 2025 | ||||
| Document scraping from unknown bot UA is Chrome/124, IP sources all Windstream ISP |
11 | SumGuy | 2:37 pm Jan 23, 2025 |
