OpenAI Adopts Shared robots.txt Signals So Websites Can State AI Training Preferences

At a glance

OpenAI has agreed to follow a jointly agreed robots.txt signal so that website operators can state whether their content may be used for AI training. robots.txt is a text file that tells search engines and bots which rules apply to access a site.

The original site blocks automatic reading or only shows its text in a browser, so this note covers just the headline and introduction. See the original article below for the full story.