I have been getting an extraordinary number of bots from the Hetzner Online ASN, with the domain your-server.de. Almost 30,000 requests per day (my site is medium size).
I have this ASN set to challenge in Cloudflare, but I'm still curious as to what these bots are.
About 10,000 of the requests identify themselves as BLEXBot/1.0. Another 1k are DataForSeoBot. The rest are just a wide variety of User Agents, with no discernable crawling pattern.
Some appear to be associated with ad placement checkers, particularly a group of IPs that geomap to Finland.
Many vary the User Agent slightly with each request. For example, here is a series of agents from one IP, sequentially:
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36 Edg/87.0.664.57
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.67 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.183 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.1 Safari/605.1.15
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.2 Safari/605.1.15
Anyone know anything about these?
