Google joins OpenAI, Anthropic and Microsoft on shared AI scraping signal
BROBROK News · Based on reporting by DiarioBitcoin ·
Google, OpenAI, Anthropic and Microsoft will respect a new robots.txt directive that lets websites use one common signal to allow or deny content for generative AI training. The proposal is still under review at the IETF and does not stop search indexing or undo data already collected.
Key points
- The proposal introduces the __usage_ai-training user agent as a shared signal.
- Site owners could allow or block AI training access for specific paths.
- Anthropic has already started supporting it; others plan staged rollouts.
- The signal does not prevent pages from appearing in Google Search.
- It does not remove content that companies collected before the rule was added.
Why it matters
This gives publishers a simpler way to express how their content can be used for AI training. It also shows major AI and search firms moving toward a common standard for crawler permissions.
Original headline: “Google se suma a OpenAI y Anthropic con una señal común contra el scraping para IA”
Read the original on DiarioBitcoin
Summary and analysis written by BROBROK News from the original report. Read the full story on the source website. Not investment advice.