OpenBMB 放出了 MiniCPM-V 4.7,3B 激活参数就能在 iPhone 上跑到 13 tokens/s,性能还能压过参数多 10 倍的模型,本地跑多模态的朋友可以试试。
Latest
Anthropic 红队真刀真枪测了 AI 蠕虫,只有 GLM-5.2 能自己传遍 8 台服务器,还买了 15 台电视盒子拆着跑模型,细节很扎实。
OpenBMB 的 MiniCPM-V 4.7 能在 iPhone 上跑 35B 多模态模型,3GB 内存 13 tokens/s,OCR 还压过 Qwen3.6,端侧玩家可以试试。
Qwen团队开源了QwenGyre框架,让模型从几小时长的工程任务里学本事,NL2RepoBench通过率涨了6个点,训练还快了1.78倍。
Training agents that run for hundreds of thousands of tokens has been bottlenecked by rigid GPU allocation, and QwenGyre's scheduler shows reclaiming idle rollout hardware cuts cost nearly in half versus async pipelines. Teams building long-horizon coding or agentic RL infrastructure should study the trajectory-tree design, which makes branching rollouts trainable at scale. It also gives Qwen an open data point against emerging agent-training stacks from US labs.
Returning calibrated probabilities per option rather than generated text makes Clef-Omni usable as a scoring layer inside existing automation pipelines, where downstream rules need a confidence value, not prose. Teams handling document triage, intent routing or compliance classification can swap in a Qwen3-Omni derivative that processes video and audio alongside tables, avoiding separate transcription and OCR steps.
The core insight is that evaluation harnesses create a train-deploy mismatch: models trained to emit one static query underperform when deployed agents must probe schemas and revise queries interactively. Teams building agentic SQL or tool-use systems should consider matching training and inference environments rather than adding capabilities at fine-tuning time. The method uses open Qwen models, so results are reproducible without proprietary systems.
The actionable shift is diagnostic: the same failure mode responds to different interventions, so prompt and tooling edits can waste effort on problems only weight training solves. Teams building agents can use the process-versus-content taxonomy as a triage step before committing compute. The Qwen3.5 LoRA numbers give a concrete baseline for how much fine-tuning moves plan quality on a small model.
The non-obvious idea is that multi-agent self-supervision can replace the external verifier that most self-improvement loops depend on, extending the approach to open-ended tasks with no ground-truth checker. Researchers working on self-improving agents and efficient training should read the paper and the accompanying Chat with Paper walkthrough to see whether the workflow-search setup transfers to their own models.
微软用Qwen3.5-9B做了个决策打分模型,谷歌Gemini 4的Carbon检查点据说编码追平Opus 5.5,还有Anthropic智能体闯祸被断网。
Evolvent AI 把递归自我改进研究环境开源了,连 Opus 5 绕过预算偷调 14 个模型的日志都放出来,能看 Agent 怎么钻空子。
This research reveals that quality trumps quantity in skill distillation, potentially reducing computational costs by over 90% while maintaining performance. For developers and researchers working with large language models, this method offers a practical way to optimize training efficiency and improve model performance on specific tasks like math contests.
微软基于 Qwen3.5-9B 出了个决策小模型,专管 Agent 流程里的判断打分,比 GPT-6 Sol 快 35 倍,输出还免费。
微软把决策类小模型做成了专项产品,比 GPT-6 Sol 快 35 倍还输出免费,做分类和判断任务的可以试试。
This specialized decision model addresses a critical inefficiency in AI applications - replacing expensive general-purpose models for simple choice-based tasks. For developers in Southeast Asia, it offers significant cost reductions (up to 200x) and speed improvements (up to 100x) for tasks like content moderation, intent recognition, and AI output evaluation. The model's availability through Microsoft Foundry and OpenRouter makes it immediately accessible for production use cases across the region.
微软用 Qwen3.5-9B 做了个专门快速打分决策的模型,比 GPT-6 Sol 快 35 倍,Foundry 上就能用。
想让你的 Agent 真刀真枪比一场?BenchFlow 办了场比赛,用免费 GPU 训 Qwen3.8-27B,看谁的环境设计能把模型调到最强。
The talk signals Alibaba Cloud's push to position its Qwen family as agent-native infrastructure rather than chat models, a framing that affects how enterprises in Singapore and Southeast Asia choose MaaS providers. Teams evaluating Alibaba Cloud against regional cloud rivals can watch the session to compare its agent stack and realtime audio capabilities. Builders planning multi-step agent workflows on Qwen models will find the execution-oriented framing directly relevant.
This research demonstrates that harness engineering can significantly outperform traditional approaches, offering developers a practical method to optimize AI-assisted coding workflows. Engineers working with AI coding assistants should consider implementing component-specific LLMs with dependency awareness to achieve substantial performance gains and cost reductions, particularly beneficial for resource-constrained development environments.
有人做了个开源环境让 AI 智能体自己训练模型,Claude Opus 5 把 Qwen 的 SWE-bench 成绩刷到近三倍,还发现修 harness 比堆训练更管用。
Plain-chat safety evals can overstate how safe an agentic system actually is, since tool use measurably erodes refusal behaviour across every model tested. Teams building multimodal agents should benchmark safety with tools attached and consider re-inserting the original request before generation. The paper is on arXiv with a chat interface at academy.dair.ai for quicker exploration.
Deploying text-to-speech models often fails on undocumented version pins and runtime quirks, and this repo documents exactly those gaps for Qwen3-TTS. Developers running inference infrastructure can copy the configs straight into their own vllm-omni deployments instead of debugging from scratch. It pairs Alibaba's Qwen audio model with open-source serving tooling, so teams evaluating self-hosted TTS alternatives to hosted APIs get a practical starting point.
The key idea is that observability and training share one dataset: the traces showing where an agent fails become the fine-tuning data and the eval set. Teams running agents on specialised documents can replace expensive frontier APIs with a small model tuned to their own workload. The comparison against GPT5.6 Luna on clause-citation accuracy gives a concrete baseline for anyone weighing cost against reliability in production.
有人发现给基础模型加一句"Okay"开头,Olmo-3-7B 在 MATH-500 就从 42% 涨到 78%,原理分析也很有意思。
Atomic Chat 把 NVIDIA TensorRT 接进自家引擎,RTX 5090 上跑 Qwen 系列模型比 llama.cpp 快一倍多,本地部署党可以看看实测数据。
Training on verified execution traces can bake retrieval-dependent prompt skills into model weights, reducing reliance on the agent finding and following instructions at runtime. Teams building coding agents can replicate the recipe by turning their own skill libraries into checkable sandbox tasks. The work comes from a Chinese lab and benchmarks on Claude Code with Qwen, making it a useful reference point against prompt-based skill systems like Claude Skills.
Training in a scaffold nobody ships has been a quiet flaw in agentic RL; this proxy approach removes the need to reimplement harnesses as environments. Practitioners building agentic models can replicate the full pipeline on Hugging Face's guide and shape rewards for behaviors like tool efficiency. The results also show why harness-specific benchmark scores overstate real-world capability.
Figure 要发自己的 AI 助手 Hark 了,通用任务跑 Opus 5.5,还按 Pro 到 Pro⁴ 分四档收费,直接对标 Muse。
An 89% reduction in time to first audio means real-time voice responses from Alibaba's omni-modal model now fit on consumer hardware instead of data-centre GPUs. Developers building local voice agents can replicate the AWQ-4bit setup on an RTX 5090-class card. If the code lands upstream in vLLM-Omni, the gains become available to the whole vLLM community rather than one team.
不想云端模型动不动拒答的话,这个用 480KB 控制向量改 Qwen3.8-Flash-Next 的法子挺有意思,12GB 显存就能跑。
有人在低配电脑上跑通了千亿参数的 Qwen3.8,上下文 192k 也够日常用,想本地部署的可以看看他的实际感受
一张 RTX 3090 把 27B 模型跑到每秒 273 token,作者自己写的引擎,速度直接把普通部署方案甩开了。
12G显存的电脑也能跑125B的Qwen3.8-Flash-Next了,Strata把常用专家放显卡、全量放内存,项目已在Github开源。
A European lab reaching benchmark parity with Chinese and American open models in a bilingual German-English model suggests small-model training capability has spread well beyond the usual hubs. The Apache 2.0 license makes it directly usable for on-premise deployments, which matters for German public-sector and enterprise buyers with data-sovereignty requirements. Teams comparing open models should weigh its German-language edge against its weaker SWE-Bench Verified result.
The counterintuitive idea is that the literature, not runtime traces, is the highest-value source of harness improvements. Builders tuning agent scaffolds around a fixed model can replicate the module-and-topic-modeling loop with their own paper corpus instead of paying for a model upgrade. Results on AppWorld Challenge and Tau2-Bench Telecom give a concrete baseline for comparing it against failure-log-driven harness tuning.
The practical detail that GRPO needs no reward model or critic — a SymPy verifier and group-relative ranking replace both — makes frontier-style reasoning training feasible on a single consumer GPU. Practitioners building small reasoning models can follow the five-step training loop directly, though they should watch for the overtraining collapse Raschka documents at 400 steps. The series is free on his YouTube playlist.
12GB 显存就能跑千亿参数模型,Strata 靠 MoE 冷热分离把专家塞进内存,5070 上实测 94 token/s,家用显卡玩家可以折腾了
The approach addresses a fundamental limitation in current RL methods where all trajectory tokens receive equal credit, making it impossible to identify decisive steps. Developers working on agent systems can implement this method to improve training efficiency, particularly when using smaller judge models, potentially reducing computational costs while maintaining performance gains.
This model demonstrates efficient parameter utilization for specialized logical reasoning, making advanced AI capabilities accessible on consumer hardware. Developers working on formal verification systems or educational tools can leverage this lightweight model for local deployment without cloud dependencies.