AI BriefingGoogle to support shared AI training control in robots.txt in 2027
·2026.10.30 09:00
Key point
The mechanism allows website owners to opt out of AI training across multiple providers using a single policy token, building on the Google-Extended control available since 2023.
Details
- Google announces plans to support a shared AI training control in robots.txt, based on work from the AIPREF working group at the IETF.
- Website owners will use a shared 'policy token' to set broad preferences across participating AI providers, avoiding the need to manage separate instructions for each developer.
- If a website opts out via the policy token and does not explicitly specify Google-Extended, Google will interpret this as a disallow for Google-Extended.
- Existing company-specific controls, such as Google-Extended, will continue to function alongside the new joint signal, allowing for tailored instructions.
- Support for this control is aimed for 2027, aligning with the EU Code of Practice for General Purpose AI (GPAI) Model Providers under the EU AI Act.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.
Related
Judge rules Anthropic illegally trained Claude on pirated booksMeta revises commercial terms to remove 'train' but retains broad scraping rights for AI business products
HUMXN offers free home repairs in three cities to train AI robots with real-world data