Event ·Multi-source

OpenAI、谷歌、微软和 Anthropic 联手推行 AI 数据抓取退出标准

OpenAI、谷歌、微软和 Anthropic 宣布将采用一项新的内容抓取退出标准，该标准由 Anthropic 技术负责人 Kevin Kelley 向互联网工程任务组（IETF）提出，集成在网站的 robots.txt 文件中。内容发布方可以一次性向多家 AI 企业统一申明针对模型训练的内容使用偏好，无需再为每家公司单独设置规则。目前 Anthropic 已率先采纳，OpenAI 计划在未来几个月内落实，谷歌和微软预计于明年支持。Meta 发言人 Andy Stone 表示支持建立此类通用信号，但未公布具体落地时间。

Current read

四大 AI 公司一起搞了个 robots.txt 新标准，网站主写一次声明就能管住所有 AI 爬虫，不用挨家挨户设置了。

11 sources66° AI heatLast updated 2026/11/1 14:19:52

Evidence

11 sources

Primary sourceIT之家

2026/11/1 14:19:52View source

Related source 1Blognone

2026/10/31 09:02:01View source

Related source 2theverge

2026/10/30 20:26:10View source

Related source 3VnExpress Số hóa

2026/10/31 09:30:00View source

Related source 4Inquirer: Technology

2026/10/31 14:10:27View source

Related source 5marktechpost

2026/10/30 17:34:15View source

Related source 6Decoder

2026/10/30 17:44:59View source

Related source 7Tech in Asia

2026/10/31 04:42:16View source

Related source 8The Straits Times: Business

2026/10/31 08:25:00View source

Related source 9rohanpaul_ai

2026/10/31 10:00:58View source

Related source 10TestingCatalog

2026/10/31 10:08:46View source

Conflict check

Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.

Open the story