Proximal发布FrontierSWE v2编程基准

Excited to see benchmarks headed in this direction and getting better!

精选理由

Proximal发布了新版编程基准FrontierSWE v2,Claude Fable 5.1在测试中表现最佳。

AI 摘要

Proximal公司发布了FrontierSWE v2,这是一个更新的超长视野编程基准。新版本v2扩展了任务套件并改进了方法论。基准测试显示前沿模型之间存在较大性能差距,Claude Fable 5.1以显著优势领先。

原文 · Suhail

Excited to see benchmarks headed in this direction and getting better!

Excited to see benchmarks headed in this direction and getting better! Proximal @ProximalHQ We are releasing FrontierSWE v2, our updated ultra-long horizon coding benchmark V2 features an expanded task suite and improved methodology. We see large performance gaps between frontier models, with Claude Fable 5.1 leading by a wide margin 🔗 View Quoted Tweet 💬 1 🔄 0 ❤️ 12 👀 1509 📊 2 ⚡