OpenAI announced on October 30, 2026 that it will honor a shared signal in robots.txt, the file websites use to express preferences about how their content is used, so that site operators can communicate a single AI training preference to multiple participating providers at once. A Voluntary Signal Shared Across Providers In its announcement, OpenAI described the effort as voluntary and said it addresses an existing burden: until now, website operators had to identify individual crawlers and…
This article has been indexed from Unite.AI
Read the original article:
OpenAI to Honor Shared Robots.txt Signal for AI Training Preferences