Google, Anthropic and others to support new AI crawling opt-out standard

SiliconANGLEOctober 31, 2026en

Google LLC, Microsoft Corp., Anthropic PBC and OpenAI Group PBC today announced plans to support an upcoming website crawling standard. The technology will enable website operators to block artificial intelligence developers from using their content to train their models. Many websites contain a text file titled “robots.txt” that informs crawlers what content they may access. […] The post Google, Anthropic and others to support new AI crawling opt-out standard appeared first on SiliconANGLE .

This is a short summary published by AI Global Wire. The full article is owned and hosted by SiliconANGLE — open it there to read it in full.

• OpenAI
• Anthropic
• Google
• Verktyg