Inkling 2 small 发布:MoE 架构 594B 参数,权重下周开源
Mira Murati 团队的新模型 Inkling 2 small,激活参数只有 17B 却在 DesignArena 排第 3,下周 Apache 2.0 开源,可以自己部署跑跑看。
Inkling 2 small 是一款 MoE 模型,总参数量 594B,激活参数 17B,支持图像输入和可变推理力度。在编程基准测试中,它的表现与体量大得多的模型持平。在 DesignArena 排行榜上位列第 3,仅次于大型闭源前沿模型。权重将以 Apache 2.0 许可证于下周开放下载。
Inkling 2 small is an extremely impressive release, especially for its size.
It is a Mixture-of-Experts model with 594B total parameters, 17B active, and supports image inputs and variable effort.
In coding benchmarks, it easily keeps pace with significantly larger models. What is particularly interesting, however, is that it ranks 3rd in DesignArena, for example, placing just behind massive, closed-source frontier models.
Full weights available under an Apache 2.0 license next week. Really impressive release. Kudos, Mira Murati!