Arena 推出 Coding Index,GPT-6.2 Astra 编码得分 1338 位列第 3
Arena 用真实会话数据给编码智能体排了座次。GPT-6.2 Astra 编码 1338 分排第 3,成本还降了 62%;Sol 走低价路线。选模型或算预算的工程师可以直接看这份榜单对号入座。
Arena 推出全新 Coding Index 与 Agent Arena Index 两个榜单,用于衡量智能体在真实编码任务与综合任务上的表现。OpenAI 的 GPT-6.2 Astra (Max) 在 Coding Index 上拿到 1338 分排名第 3,比上一代 GPT-6 Astra (Max) 高出 50 分,同时每任务中位成本从 $12.55 降至 $4.75,降幅 62%,进入成本 Pareto 前沿。在综合性的 Agent Arena Index 上,GPT-6.2 Astra 以 1291 分排名第 6,GPT-6.2 Sol (Max) 以 1241 分排名第 11。
这两个榜单基于全球社区数百万次真实任务轨迹构建,此次 GPT-6.2 两款模型的评分来自 7.1K+ 次真实智能体会话数据。Astra 在用户满意度指标(Praise vs Complaint)上以 1462 分排名第 5,每任务中位成本 $2.94,比 GPT-6 Astra 的 $4.91 低 40%。Sol 则以 $0.90 的每任务成本比 GPT-6.1 Sol (Max) 低 13%,同样进入 Pareto 前沿。
Astra 与 Sol 定位差异明显:Astra 综合分高出 Sol 50 分,但 Sol 每任务成本低 69%。对开发者和选型的团队来说,这组数据提供了按预算和性能权衡的具体参考坐标。
Introducing Arena’s Coding Index: measuring which agents are best at real coding work. For GPT-6.2 Astra (Max) by @OpenAI , coding is a strength. On the Coding Index specifically, it scored 1338 pts at #3 ! Its overall Agent Arena Index score landed at 1291 pts at #6 . This Coding Index score of 1338 is +50 pts over its previous variant, GPT-6 Astra (Max), at 62% lower median cost per task ($4.75 vs. $12.55), earning a spot on the cost Pareto frontier for the Coding Index (see placement in thread). Congrats to the @OpenAI team! Arena.ai @arena Scores for GPT-6.2 Astra and Sol are on the NEW Agent Arena Index! - #6 with 1291 pts: GPT-6.2 Astra (Max), now @OpenAI ’s best model - #11 with 1241 pts: GPT-6.2 Sol (Max), joining the cost Pareto frontier The Agent Arena Index is our new headline measure of overall agent performance, built from millions of real-world tasks and traces from our global community. Results for GPT-6.2 Astra and Sol are based on 7.1K+ real agentic sessions. GPT-6.2 Astra: #6 with 1291 pts - +9 pts vs previous variant GPT-6 Astra (Max), currently #7 - Median cost per task: $2.94 vs. $4.91 for GPT-6 Astra, 40% lower - Strongest signal: #5 with 1462 pts in Praise vs Complaint (user satisfaction with agent's outcome) GPT-6.2 Sol: #11 with 1241 pts - Matches #12 GPT-6.1 Sol (Max) with 1241 pts, at a 13% lower median cost per task ($0.90 vs. $1.04) - Joins the Pareto frontier (see placement in thread) 6.2 Astra vs. Sol - Astra scores +50 pts above Sol at #6 vs #11 - Sol’s median cost per task is 69% lower ($0.90 vs. $2.94) Congrats to the team at @OpenAI on this release! 🔗 View Quoted Tweet📊 4 ⚡
This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to US-China foundation model benchmarks and commercialization comparison and AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include OpenAI, GPT-6.2, Arena, Coding Index.
Source attribution: curated from lmarena.ai (@lmarena_ai). Cross-source corroboration: 11 independent sources have covered this development (including Artificial Analysis, Yuchen Jin, TestingCatalog), confirming industry-wide signal strength.