ProductsMulti-source

OpenAI 发布图像分类器,ChatGPT 加入儿童性虐待内容拦截警告

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

Why we picked it

OpenAI 把 CSAM 图像分类器直接接进 ChatGPT 了,还配了 24 小时封号警告机制。做 UGC 图像产品或内容审核的同学可以看看它的拦截逻辑,比自己从零搭一套分类器省事不少。

OpenAI 于 11 月 16 日发布了一个新的图像分类器,用于识别儿童性虐待材料(CSAM)。配合该分类器上线,ChatGPT 还新增了账号警告机制:试图访问 CSAM 内容的账号将被封禁 24 小时作为首次警告。

Image · techcrunch
Body

分类器部署在模型侧,由系统自动检测用户上传或生成的图像,命中后触发拦截与账号处置流程。这类工具此前多由 Thorn 等专业反儿童性剥削组织或平台信任安全团队提供,OpenAI 将检测能力内置到 ChatGPT 的对话与图像流程中,意味着生成式 AI 平台开始把 CSAM 防护作为产品默认环节。

对开发者和平台方而言,这套“分类器 + 账号警告”的组合可作为自建内容安全体系的参考,尤其是面向 UGC 图像场景的服务商。

Original · techcrunch

OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM

ChatGPT will ban an account trying to access CSAM content for 24 hours as a warning

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Products" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI regulation, compliance frameworks, and sovereign compute policy and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include OpenAI, ChatGPT, AI safety, content moderation.

Source attribution: curated from techcrunch (@Ivan Mehta). Cross-source corroboration: 11 independent sources have covered this development (including @koltregaskes, Tibor Blaho, Techsauce), confirming industry-wide signal strength.