newsOctober 30, 2026·The Verge AI
The biggest names in AI are backing a new way to opt out of scraping
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable. With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setti
ng them individually. The shared "policy token" signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF). It will live within a website's robots.txt file, which has long signaled which web crawlers can and can't scrape a site - whether for search indexing, archiving, or … Read the full story at The Verge.
Key Takeaways
- •The shared "policy token" signal is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF).
- •This story was reported by The Verge AI, covering developments in the news space.
- •AI advancements continue to reshape industries — read the full article on The Verge AI for complete coverage.
📖 Continue reading the full article:
Read Full Article on The Verge AI →
