Perplexity:CTF 红队测试中“找 flag”目标可能浪费 Agent 算力
Perplexity 团队做安全测试时的一个坑:让 Agent 去找 CTF flag,结果它花力气解题而不是测真正的安全边界。他们还发现安全专项训练的模型也没占便宜。做 Agent 安全评测的人应该看看这条经验。
Perplexity 团队发现,安全红队测试中常见的 CTF 挑战存在一个结构性问题:让 Agent“find the flag”的指令会让模型把算力花在与真实安全边界无关的任务上。也就是说,Agent 可能在解谜、绕过题目设定,而不是测试目标系统真正要防护的漏洞。
他们还指出,用安全专项数据训练的模型在这类任务上并没有表现更好,说明安全能力不能只靠特定领域训练数据堆出来。这条经验对做 Agent 安全评估的团队有直接参考价值:评测目标的设计比模型本身更值得先审视。
We found that while CTF challenges are common in security red-teaming, asking agents to “find the flag” can waste effort on tasks that don’t actually test the target security boundary. Security-specific model training also didn't guarantee better results on our tasks.📊 1 ⚡
This report is categorized under AITOP's "How-to" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Perplexity, CTF, 安全红队, 智能体.
Source attribution: curated from Perplexity (@perplexity_ai).