小米 MiMo V2.6 Pro 超过 DeepSeek 登上 Agent Arena 开源第一,单任务才 $0.11,做智能体的可以看看这份榜单。
Latest
Speed, not raw accuracy, is the headline here: a 55% reduction in total task time against DeepSeek V4.1 Flash suggests latency-sensitive agent pipelines are where this model fits best. Developers building Deep Agents workflows in Python can test it directly through ChatNVIDIA with open weights, making self-hosting or cost comparison against closed APIs straightforward.
Serving efficiency, not raw scale, is where V4.1 Flash wins: it delivers 1.3x to 6.2x the throughput per MW of V4 Pro 0813 across Blackwell hardware while scoring higher on intelligence. Teams running agentic coding workloads can use the AA-AgentPerf data to pick hardware — B300 nodes stay within about 20% of rack-scale GB300 NVL72, so single 8-GPU nodes are viable for this model. As an open-weights release from DeepSeek, it widens cheap self-hosting options for Southeast Asian inference providers competing with rented frontier APIs.
The MI355X's 288GB of HBM3E per GPU gives it an edge on very large models like the 1.6T-parameter DeepSeek V4 Pro, but serving-stack maturity on ROCm remains the bottleneck at higher loads. Teams evaluating accelerator purchases for agentic inference can now compare AMD and NVIDIA on realistic coding-agent workloads rather than synthetic throughput numbers. All results run on ROCm nightly builds of vLLM and SGLang, so scores should improve as the software stack matures.
有人发现 DeepSeek V4.1 给自己打分挺高,给同样是自己扮演的子智能体打分却低不少,这个自评偏差挺有意思。
ARC Prize 实测了 DeepSeek V4.1 Flash,ARC-AGI-3 跑出 3.3%,成本不到 1000 美元,目前性价比最好的一份成绩单。
The benchmark penalises behaviours conventional evals ignore, such as oversized diffs, out-of-scope file edits and unhelpful tests, so its ranking offers a different picture of coding ability than SWE-style test suites. Even the best model fails over 40% of tasks, meaning maintainer cleanup is still unavoidable. Teams choosing models by cost-performance should note GPT-6.1 Sol matching Claude Fable 5.1 at under a tenth of the per-task price.
The benchmark's merge-focused grading penalises the messy diffs and unhelpful tests that cheaper evaluations ignore, so leaderboard gaps here reflect real maintainer acceptance rather than raw test-passing. Leading models still fail over 40% of tasks, and nine tasks went unsolved by every model evaluated. Teams choosing coding agents can weigh GPT-6.1 Sol's 49% score at US$0.81 per task against Claude Opus 5.5's 52% at far higher cost, with open-weights options like MiMo-V2.6-Pro at 45% close behind.
LMArena 给出实测数据:Kimi K3 和 DeepSeek V4.1 Flash 用不到一成的成本追平了 Claude Fable 5,做 agent 选型前可以看看这份榜单。
This approach offers a lightweight way to update models without full retraining, potentially reducing costs for personalized AI applications. Developers working with large language models could implement this technique for efficient knowledge updates, especially useful for applications requiring frequent factual updates or user-specific customization.
The evaluation suggests routers are judged less on raw cost-performance and more on how quickly they adapt to user feedback, where Jev Router nearly matches Claude Opus 5.5 (High). Teams building multi-model agent pipelines can use these latency and cost figures to decide whether a routing layer beats picking DeepSeek V4.1 Flash directly. The full thread contains additional session-level insights.
LMArena测了Jev Router的实际延迟:中位数6.18秒,比DeepSeek V4.1 Flash的3.64秒慢了一截,P90差距更明显。
DeepSeek 的 V4.1 Flash 跑分出来了,ARC-AGI-2 拿下 72.9%,比上一代高了 11.5 分,不过每任务成本贵了两倍多,看你怎么权衡。
Mistral放出Mistral Large 4,1T参数只激活49B,跑分被DeepSeek V4.1 Flash压了一头,10月就开源,可以先试试API。
Reflection AI 开源了 Beam,501B 参数 MoE,作者称推理算力只要 GLM-5.2 的三分之一,Apache 2.0 可商用,不过注意这数字只是估算。
The reveal of DSec provides insights into how DeepSeek optimizes its massive model training infrastructure, which could influence industry approaches to resource allocation. For developers and researchers working with large models, understanding this distributed architecture could inform their own training strategies and resource planning.
Stanford 联合 Terminal-Bench 团队搞了个科研智能体榜单,70 个真实科研任务里 GPT-6 Astra 拿 63% 排第一,开源模型才 10%,差距很直观。
Cline 里免费用 Gemini 3.8 Flash,1M 上下文加 291 tok/s,跑分还压过 GPT-5.6 Luna 和 DeepSeek v4.1 Flash,写代码可以直接试。
有人拿 DeepSeek V4.1 Flash 和 Space Bunny Alpha 现场比拼,让两个模型各自写一个网页版 Minecraft,前者能跑能挖,后者地面还有破洞,结果一目了然。
Zenith 用最便宜的 DeepSeek v4.1 Flash 打赢了 GPT 5.6 Sol,开源党可以看看它怎么做到的。
有人推测 DeepSeek V4.1 会用 YOCO 这类新架构,如果靠谱,KV 缓存开销可能大幅下降,架构党可以留意。
小米的 MiMo v2.6 Flash 跑分接近 Grok 4.7,成本却只有 1/57,做 agent 的可以看看这份 60 任务实测。
Grok 4.7 浏览器任务 39.9 分,比上代涨 8.7,但只有 GPT-6 Astra 一半。
OpenAI 用 1 万个代理做了个实验,结果挺有意思的,DeepSeek 也出了个新版本,对长文本处理更便宜了。
智谱AI新出的GLM 5.3 FlashX模型,性能确实有提升,但价格比之前贵不少,而且被DeepSeek的v4.1 Flash模型给超越了。
Bolt 上开源模型首周,开发者选最快 DeepSeek V4.1 Flash,该版本在 Bolt Forge 中上线,使用量是 DeepSeek V4 Pro 的 10 倍。
For those interested in the future of AI development, Liu Shengyu's perspective offers a rare and candid look at the challenges and motivations of a leading engineer working on a major model.
DeepSWE测试发现DeepSeek V4.1-Flash的输入token消耗远高于输出,缓存命中率高,能大幅降低成本。
This is a major upgrade for the DeepSeek model, showing significant progress in its architecture and scale.
For developers, this matters because it shows DeepSeek V4.1 Flash's coding capabilities are robust and not tied to a specific agent framework, making it a versatile choice for different coding tasks.
DeepSeek 新模型 V4.1 Flash 性价比很高,在 OpenRouter 上 24 小时处理 1T token,比 GLM-5.3 Flash 便宜 5 倍。
For users looking for a more affordable and efficient large language model, DeepSeek V4.1 Flash offers a clear upgrade path from the V4 Pro model.
DeepSeek 新模型比 OpenAI 和 Z.AI 便宜,性能还更好,值得看看。
DeepSeek 推出了 V4.1 Flash,性能接近 GPT-5.6,但成本只有 1/30,用 15 美元就能跑 100 个复杂任务,性价比很高。
DeepSeek 新发布的 V4.1 Flash 模型,推理速度更快,价格也降了 60%,比之前的 V4 Pro 强很多。