SWE-bench 联合作者 OfirPress 分享打造影响力基准的经验
SWE-bench 作者亲口讲它怎么从没人理变成编程评测的事实标准。想做评测基准的研究者、或者好奇 Pr Inceton 那套思路怎么落地的都该听听。访谈形式，比读论文更容易吸收经验。
Kaggle 推出播客节目 Evaluated 第一期，由 Gina Lee 主持，嘉宾是 SWE-bench 联合作者 OfirPress。SWE-bench 如今是 AI 编程领域最具影响力的基准之一，但上线初期反响平平。
OfirPress 在节目中给出的核心建议是从人出发：先找到可以互相碰撞想法的合作伙伴，再选择那些看起来几乎不可能解决的硬问题。他回顾了 SWE-bench 从冷启动到被广泛采用的过程。
对想设计下一代评测基准的研究者来说，这期内容提供了来自 SWE-bench 作者的一手经验，涉及选题、组队和推广的完整路径。
Want to build the next SWE-bench?
Its co-author @OfirPress says to start with people. Find teammates you can bounce ideas off of, then work on really tough problems that seem absolutely impossible.
He shares how SWE-bench went from a lukewarm launch to one of AI coding's most influential benchmarks in the first episode of Evaluated, hosted by Gina Lee.
Here's a sneak peek:
This report is categorized under AITOP's "How-to" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include SWE-bench, Kaggle, OfirPress, benchmarks.
Source attribution: curated from Kaggle (@kaggle).
