Cloudflare to launch platform to allow users to trade rights to scrape websites for AI



Cloudflare, which provides services such as CDN and DDoS protection, has announced `` AI Audit ,'' a tool for analyzing and controlling bots that scrape websites for training AI.

Cloudflare Helps Content Creators Regain Control of their Content from AI Bots | Cloudflare

https://www.cloudflare.com/press-releases/2024/cloudflare-helps-content-creators-regain-control-of-content-from-ai/



To gather training data, AI companies scan the content of everything from commercial media and news sites to small personal sites. Until now, website owners have had little to no way of countering these scans and no control over how their content is used.

Cloudflare's 'AI Audit' is a tool that allows content creators to regain control, and it has the following features:

・Automatic control of AI bots for free
Cloudflare identifies access by AI bots, allowing you to block all AI bots with one click.

・Analyze AI bot access
Analytics are provided to understand why, when and how often AI bots are accessing websites, and can distinguish between AI that links to the source of data when generating responses and AI that obtains data without attribution or credit.



・Providing data that will be useful in negotiations with AI model development companies
When licensing your content to companies developing AI models, you can use advanced analytics to understand metrics commonly used in negotiations, such as crawl rates for sections of pages, and you can also use models to set terms of use for your site to protect your legal rights.

Set a fair price for the rights to scan content
Many site managers do not have the resources or expertise to negotiate with AI model development companies, and conversely, it is difficult for AI model development companies to negotiate with each individual site. By using this function, site managers can set prices for their content and smoothly receive compensation from AI model development companies.

AI Audit was available immediately after its announcement, but the 'Set a fair price' feature is still in development, and you need to join

a waiting list to use it.

in Web Service, Posted by log1d_ts