Primary sourceelvis
View sourceEvent ·Multi-source
Jev 路由实测对比 GPT-6 Astra:公开基准数字参考价值有限
独立研究者用自建 harness 测试 Jev Router 在智能体任务中的表现,成绩与 GPT-6 Astra low 相当,但运行时间更长。Theo 用另一套 scoped tests 测了 DeepSWE,两套测试内容不同,结论有分歧也有共识。作者强调 Jev 是 System One 模型,不应与 GPT-6 Astra 这类 System Two 模型直接对比,更值得探索的是两者结合的路由方案。
Current read
有人拿自建 harness 实测了 Jev 路由,性能能追平 GPT-6 Astra low,代价是跑得更久。文章还讨论了为什么公开基准分数别太当真。
11 sources72° AI heatLast updated 2026/9/26 21:13:12
Evidence
11 sourcesRelated source 1Artificial Analysis
View sourceRelated source 2@OpenAIDevs
View sourceRelated source 3Y Combinator
View sourceRelated source 4Decoder
View sourceRelated source 5arXiv cs.AI
View sourceRelated source 6kimmonismus
View sourceRelated source 7IT之家
View sourceRelated source 8Viking
View sourceRelated source 9Aravind Srinivas
View sourceRelated source 10Justine Moore
View sourceConflict check
Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.