腾讯 Hunyuan Hy4 登顶 CWE-Bench-AA,Artificial Analysis Cyber Index 排名第三
腾讯 Hunyuan Hy4 这次在安全任务上跑赢了 DeepSeek 和 Grok,价格还只要 Grok 的十一分之一,输出 token 也更省。做安全自动化或者想给智能体挑便宜模型的开发者可以看看这份对比数据。
腾讯 Hunyuan 的 Hy4 在 Artificial Analysis Cyber Index 得分 58%,排名第三,领先 DeepSeek V4.1 Flash 1017 (max) 1 分,落后 Kimi K3.1 Pro (64%) 和受信任访问的 GPT-6 Sol (Daybreak Blue, max) (69%)。定价为每 100 万输入/输出 token 0.834/2.501 美元。
Hy4 在 CWE-Bench-AA 上以 76% 的得分排名第一,该基准测试代理发现并修复真实软件漏洞的能力,领先 DeepSeek V4.1 Flash 1017 (max) 6 分。在成本效率上,Hy4 每个任务花费 0.92 美元,位于能力-成本帕累托前沿:得分比 Grok 4.7 (xhigh) 高 2 分,但成本仅为其 1/11;比 DeepSeek V4.1 Flash 1017 (max) 高 1 分,但成本是其 2 倍。
Hy4 每任务输出 64k token,比 DeepSeek V4.1 Flash 1017 (max) 少 43%,比 Grok 4.7 (xhigh) 少 37%,但比 Kimi K3.1 Pro 多 49%,比 GPT-6 Sol 多 56%。对关注网络安全自动化成本的开发者和企业来说,这份测评给出了明确的性价比参照。
#3 on the Artificial Analysis Cyber Index and #1 on CWE-Bench-AA 🎉🎉🎉 Artificial Analysis @ArtificialAnlys Tencent's Hy4 ranks #3 on the Artificial Analysis Cyber Index and #1 on CWE-Bench-AA @TencentHunyuan 's Hy4 scores 58% on the Artificial Analysis Cyber Index, 1 point ahead of DeepSeek V4.1 Flash 1017 (max). It trails Kimi K3.1 Pro (64%) and the trusted-access GPT-6 Sol (Daybreak Blue, max) (69%). API pricing is $0.834/$2.501 per 1M input/output tokens. Key results: ➤ #1 on CWE-Bench-AA (76%). Hy4 leads DeepSeek V4.1 Flash 1017 (max) by 6 points on our implementation of @CollinearAI 's CWE-bench v1, which tests agents' ability to find and fix real software vulnerabilities ➤ Strong capability for the cost. At $0.92 per task, Hy4 sits on the Capability vs. Cost Pareto frontier. It scores 2 points above Grok 4.7 (xhigh) at 1/11th the cost and 1 point above DeepSeek V4.1 Flash 1017 (max) at 2x the cost ➤ Fewer output tokens than peers. Hy4 uses 64k output tokens per task: 43% fewer than DeepSeek V4.1 Flash 1017 (max) and 37% fewer than Grok 4.7 (xhigh), but 49% more than Kimi K3.1 Pro and 56% more than GPT-6 Sol (Daybreak Blue, max) 🔗 View Quoted Tweet📊 6 ⚡
This report is categorized under AITOP's "Models" desk, focusing on China's AI industry and domestic foundation model ecosystem. Within our cross-regional analytical framework, it directly maps to US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Hunyuan, Tencent, DeepSeek, Grok.
Source attribution: curated from Hunyuan (@TXhunyuan).