Underdog AI 把 Qwen3.8-27B 压到 2-bit,只有 7.89GB 还能跑工具调用,日常推理比原版还强,本机部署党可以试试。
Latest
微软基于 Qwen3.5-9B 出了个决策小模型,专管 Agent 流程里的判断打分,比 GPT-6 Sol 快 35 倍,输出还免费。
微软把决策类小模型做成了专项产品,比 GPT-6 Sol 快 35 倍还输出免费,做分类和判断任务的可以试试。
This specialized decision model addresses a critical inefficiency in AI applications - replacing expensive general-purpose models for simple choice-based tasks. For developers in Southeast Asia, it offers significant cost reductions (up to 200x) and speed improvements (up to 100x) for tasks like content moderation, intent recognition, and AI output evaluation. The model's availability through Microsoft Foundry and OpenRouter makes it immediately accessible for production use cases across the region.
微软用 Qwen3.5-9B 做了个专门快速打分决策的模型,比 GPT-6 Sol 快 35 倍,Foundry 上就能用。
JetBrains 开源了新的编程模型 Mellum2.1,专门练了智能体写代码的能力,高负载下吞吐量几乎是 Qwen3.5-9B 两倍,还能本地部署保数据安全。
The key idea is that observability and training share one dataset: the traces showing where an agent fails become the fine-tuning data and the eval set. Teams running agents on specialised documents can replace expensive frontier APIs with a small model tuned to their own workload. The comparison against GPT5.6 Luna on clause-citation accuracy gives a concrete baseline for anyone weighing cost against reliability in production.
12GB 显卡也能跑 125B 的 Qwen3.8-Flash-Next 了,Strata 开源,RTX 5070 上 94 词元/秒,配置门槛和 GitHub 链接都在文里。
Training in a scaffold nobody ships has been a quiet flaw in agentic RL; this proxy approach removes the need to reimplement harnesses as environments. Practitioners building agentic models can replicate the full pipeline on Hugging Face's guide and shape rewards for behaviors like tool efficiency. The results also show why harness-specific benchmark scores overstate real-world capability.
不生成文本、只做分类决策的 Jev 三周就跑到日处理 1 万亿 token,OpenAI 和 Cloudflare 都出了同路线产品,挺值得了解的新方向。
长链推理时 KV 缓存会爆炸,这篇提出用增量 SVD 压到 4-5 倍还能保住准确率,比删 token 的老办法稳,做推理部署的可以看看。
A European lab reaching benchmark parity with Chinese and American open models in a bilingual German-English model suggests small-model training capability has spread well beyond the usual hubs. The Apache 2.0 license makes it directly usable for on-premise deployments, which matters for German public-sector and enterprise buyers with data-sovereignty requirements. Teams comparing open models should weigh its German-language edge against its weaker SWE-Bench Verified result.
AWS 开源了个 2B 小模型,专门替智能体做选择,115 毫秒出结果还带置信度,做路由和工具调用判断挺实用。
Cloudflare 用 Qwen 造了个决策模型,输出只按 schema 来,flash 版每百万 token 才 0.09 美元,比 Jev 便宜不少。
This model enables local AI decision-making without cloud dependency, addressing privacy concerns for sensitive applications. Developers can implement it for real-time decision tasks in edge computing environments, with performance competitive to larger models while requiring minimal resources.
This model demonstrates efficient parameter utilization for specialized logical reasoning, making advanced AI capabilities accessible on consumer hardware. Developers working on formal verification systems or educational tools can leverage this lightweight model for local deployment without cloud dependencies.
Clef's integration of visual capabilities with extended context creates new possibilities for complex business decision systems. Developers can now build multimodal applications that process both text and images simultaneously, with Cloudflare offering customization options through their new reinforcement learning product. The model's performance on Jev benchmarks positions it as a strong alternative to existing decision-focused AI systems.
The significant performance drop between ARC-AGI versions suggests challenges in maintaining reasoning capabilities across different task complexities. Developers working on reasoning models should examine Qwen's approach to template design, particularly the omission of medium reasoning guidance, which may impact token efficiency and performance consistency.
This model represents the growing trend of efficient post-training techniques enabling powerful reasoning on consumer hardware. For developers and researchers working with limited resources, TwIL-LM3-Pro offers state-of-the-art reasoning capabilities that can run locally without cloud dependency, making advanced AI more accessible for edge computing applications.
美国3.66B模型TwIL-LM3-Pro在形式逻辑测试中大幅领先中国VibeThinker-3B等模型,且支持本地运行。
This release expands open-source multilingual translation capabilities with specialized models for different use cases. Developers and content creators working with multilingual content can leverage these models for community expression translation, voice cloning, and maintaining consistency in long documents. The models offer practical alternatives to commercial translation services with more control over output style and formatting.
MetaCtrl addresses a critical inefficiency in reasoning models by dynamically determining when additional computation is beneficial, eliminating the need for predefined budgets or retraining. This plug-and-play solution significantly improves accuracy while reducing inference costs, making it valuable for developers working with resource-constrained environments. The open-source implementation allows immediate integration into existing reasoning pipelines.
EASE addresses a critical limitation in agent skill curation by solving cross-executor degradation through behavior adaptation. Developers working with multiple AI models can now use a single, more efficient curator that reduces inference tokens by 9.1-14.5% while maintaining performance across diverse executors, making it particularly valuable for organizations deploying multi-model systems.
Meta 把 RL 那套可验证奖励搬进了写作:先让 Kimi-K2.6 自动生成能区分专家和 AI 的评分标准,再用它训练 Qwen3.5-27B,盲评 95% 胜率打赢人类专家文本。
The interesting design choice is putting a scoring head on top of Qwen3.5 small models, positioning Valen as a fast reflex layer under a slower planning agent rather than a standalone reasoning model. Developers building GUI, game or robotics agents can use it to offload millisecond-level perception-to-action decisions. It competes with hand-tuned heuristics or heavyweight VLM calls for the same reflex-loop role.
阿里这次没发新模型,而是让 Qwen3.8-Max 自己训自己,33 轮迭代后成绩追上 Claude 和 GPT,还顺手把多模态价格砍了九成。
有人花 5 欧元租 GPU,让无审查版 Qwen 三十分钟改一个字节就破解了 IDM,这帖子把 AI 逆向能力聊得很具体。
阿里 Qwen3.8-Max 被曝跑了 33 轮自动训练迭代,AA 分数从 40 涨到 45,还有 2.4T 参数的说法。
Omni-modal models are shifting from perception demos to executing multi-step agent work on audio and video, a capability most Western agent stacks still lack. Builders can plug Qwen-MM-Plugins into existing harnesses or use Qwen-Live-Harness for real-time pipelines without building memory and tool routing from scratch. As an open release from Alibaba (Qwen), it gives developers in Southeast Asia and beyond a free alternative to closed multimodal APIs.
Shipping agent harnesses and plugins with the model means developers can wire real-time audio and video into existing frameworks without building the plumbing themselves. The one-million-token context window makes long-form video and audio workloads practical for teams building editors, translators or live assistants. Builders comparing open multimodal options against closed APIs should benchmark Qwen3.8-Omni-Flash's agent performance on their own tasks.
Cline 里免费用 Gemini 3.8 Flash,1M 上下文加 291 tok/s,跑分还压过 GPT-5.6 Luna 和 DeepSeek v4.1 Flash,写代码可以直接试。
用 vLLM 做 RL 训练的老大难——训练和推理数值对不上,这次在 AMD MI300X 上真做到了逐位一致,做 RL 的都该看看。
A US$17 training bill shows how cheap it has become to build a specialised classifier on a small open model like Qwen3.5 4B. Builders who need automated evaluation or routing can follow the released data recipe and finetune their own instead of paying per-call pricing on frontier models. Serverless availability at US$0 output pricing also makes it a practical comparison point against commercial moderation APIs.