Forum Moderators: Robert Charlton & goodroi
[edited by: not2easy at 11:48 am (utc) on Feb 11, 2026]
[edit reason] New month, new thread [/edit]
Some insights into the popular Singapore bot problem. It looks like they are using Starlink to evade geolocation - Starlink IP for page load (HTML) and later use a set of Alibaba Cloud IPs from Singapore to load every resource listed in that HTML (images, scripts). Blocking Singapore is not enough. It seems like ASN block of entire Starlink could be necessary.
Any ideas on how to combat this?
The ONLY ways is to get your website on Cloudflare. Block ALL ASN's from the well known network transit providers, like from Singapore and China. And for the residential IP's you need to create a Managed Challenge rule that challenges bots that land on a product or article page directly with EMPTY referrer (different than no referrer!), and registers their cookie state and if they run JS. Then the residential AI scraping bots and other cr@p will stop because it eats too much resources and effort for them so they move on.
as long as Google's profit increases in the short term it's fine by them.
And the actual AI slop video's which have increased so much that you need to check first if you are looking at actual content created by a person?