←Story detail

Trending story

Google announces plan to support robots.txt shared AI training controls

1 reports1 story updatesUpdated Oct 31 19:30

Understand this story

AI overview

On October 30, Google announced plans to support a shared AI training control signal in robots.txt, allowing website owners to express their training preferences to multiple AI vendors in a unified way, and said the goal is to implement it by 2027. The mechanism is based on the work of the IETF AI Preferences working group, writing the __usage_ai-training policy token in the User-Agent line, without adding new directive names or syntax; opt-out declarations that do not specify Google-Extended will be treated as prohibiting its use. On the same day, OpenAI committed to honoring the signal and plans to implement it within the coming months, while Microsoft announced that starting February 1, 2027, it will replace NoArchive and NoCache with the new preference.

AI-generated from public reports

Latest development · Report

Google plans to support shared AI training control signals in robots.txt

Developments

1 confirmed developments

  1. Google announces plan to support shared AI training controls in robots.txt

    Source:Unite.AI

Reports and discussion timeline

Browse reports and discussion by time. Their evidence levels remain distinct.

Oct 31

  1. Unite.AI

    Google plans to support shared AI training control signals in robots.txt

    On October 30, Google announced plans to support shared AI training control signals in robots.txt, allowing website owners to express training preferences to multiple AI vendors in a unified way, and said the goal is to implement it by 2027. The mechanism is based on the work of the IETF AI Preferences working group, writing a __usage_ai-training policy token in the User-Agent line, without adding new directive names or syntax; opt-out declarations that do not specify Google-Extended will be treated as prohibiting its use. OpenAI committed the same day to honor the signal and plans to implement it within the coming months, while Microsoft announced that starting February 1, 2027, it will replace NoArchive and NoCache with the new preference.

Related stories

  1. Related storiesOpenAI announces it will follow robots.txt shared AI training preference signal
  2. Related storiesAnthropic pitches investors and discloses revenue growth ahead of listing
  3. Related storiesAnthropic Publicly Submits S-1 Registration Statement for Proposed IPO on Nasdaq
  4. Related storiesAlphabet's third-quarter revenue and earnings per share both fell short of expectations