微软用 35B 参数模型挑战 Sonnet 4.6,证明小模型也能出奇迹——做推理应用或 Copilot 开发的团队值得关注,尤其是对数据合规有要求的项目。
微软今日发布两款新文本 LLM:MAI-Thinking-1(35B 参数,推理模型,面向早期合作伙伴)和 MAI-Code-1-Flash(5B 参数,专为 GitHub Copilot 和 VS Code 设计,已向个人用户推出)。MAI-Thinking-1 在盲测中优于 Sonnet 4.6,且参数规模较小,运行成本更低。两款模型均使用清洁、商业授权数据从头训练,未蒸馏第三方模型,也未使用未授权的网络数据。这标志着微软在低成本、合规数据训练的高效模型上迈出重要一步。
Microsoft's new MAI models
Microsoft announced two new text LLMs this morning - MAI-Thinking-1 (reasoning, 35B parameters, available to "select early partners") and MAI-Code-1-Flash (5B parameters, "purpose-built for GitHub Copilot and VS Code to deliver high performance and lower cost [...] rolling out to GitHub Copilot individual users in Visual Studio Code"). I've not been able to try either of them just yet. It's very interesting to see Microsoft releasing models with such low parameter counts, especially given how expensive larger models are to access right now. They claim MAI-Thinking-1 "is preferred to Sonnet 4.6 in our blind human side-by-side evaluations", which is impressive for a 35B model seeing as I frequently run models larger than that on my own laptop. Also of note : We trained [MAI-Thinking-1] from the ground up on enterprise grade, clean and commercially licensed data, without distillation from third-party models. And for MAI-Code-1-Flash as well: It is built end-to-end by Microsoft using clean and appropriately licensed data. I would very much like to learn more about this "appropriately licensed" data! Could these be the first generally useful code-specialist models that didn't train on an unlicensed dump of the web? Tags: llm-release , generative-ai , ai , microsoft , llms