产品精选

White Circle 开源 RISE:自动测试图像生成模型的安全限制

精选理由

RISE 专测图像生成器会不会被提示词绕过自家限制,代码开源,防御方现在就能拿来测自己的模型。

AI 安全团队 White Circle 发布开源工具 RISE,用来自动测试图像生成模型能否被诱导生成其自身规则禁止的图片。RISE 在攻击策略空间中搜索,并用一个公开的攻击模型把每条策略展开成大量具体提示词。每条策略按提示词的通过数量记分,因此即使目标模型拦截几乎全部请求,搜索仍能持续改进。代码和所用模型全部公开,防御者现在就能在自己的图像模型上运行 RISE 做测试。

原文 · rohanpaul_ai

Good safety work increasingly means good search.

White Circle’s released RISE, an automated tool for testing whether AI image generators can be tricked into making pictures their own rules forbid. It searches over attack strategies for image models. An open attacker model turns each strategy into many prompts, and the strategy gets credit for how many of them get through.

That keeps the search learning even against models that block almost everything.

The code is open, the models it uses are public, and defenders can run it on their own image models today.