Forum Moderators: open
To help preserve a safe Internet for content creators, weve just launched a brand new easy button to block all AI bots. Its available for all customers, including those on our free tier.
Last year, Cloudflare announced the ability for customers to easily block AI bots that behave well. These bots follow robots.txt, and dont use unlicensed content to train their models or run inference for RAG applications using website data. Even though these AI bots follow the rules, Cloudflare customers overwhelmingly opt to block them.
We hear clearly that customers dont want AI bots visiting their websites, and especially those that do so dishonestly. To help, weve added a brand new one-click to block all AI bots. Its available for all customers, including those on the free tier. To enable it, simply navigate to the Security > Bots section of the Cloudflare dashboard, and click the toggle labeled AI Scrapers and Crawlers.