The biggest names in AI are backing a new way to opt out of scraping

The biggest names in AI (OpenAI, Google, Microsoft, and Anthropic) are adopting a new standard to allow publishers to opt out of being scraped by AI. The new standard, proposed by Kevin Kelley, uses a shared 'policy token' signal in a website's robots.txt file to control AI training preferences across multiple AI companies. This means publishers can set their preferences once and apply them to multiple AI companies, rather than individually.