模型多源确认71°

Kimi K3 开源权重和技术报告发布:2.8T MoE 模型,1M 上下文

精选理由

Kimi K3 开源了,2.8T MoE 模型带视觉和超长上下文,还开放了底层工具链,值得研究。

Kimi AI 开源了其最强模型 Kimi K3 的权重和技术报告。K3 是一个 2.8T 参数的 MoE 模型,具备原生视觉理解和 1M token 上下文窗口。新架构使每单位计算智能提升 2.5 倍。此外,Kimi 还开源了高性能注意力内核、MoE 通信库和智能体环境基础设施。模型权重和报告已在 Hugging Face 和 GitHub 公开。

原文 · elvis

Open Frontier Intelligence! Kimi K3 open weights and technical report have arrived! Recommended reading. Kimi.ai @Kimi_Moonshot Releasing the model weights and technical report of Kimi K3. Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params. Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale. Model weights: huggingface.co/moonshotai/Kim… Tech report: github.com/MoonshotAI/Kim… Tech blog: kimi.com/blog/kimi-k3 🔗 View Quoted Tweet 💬 1 🔄 2 ❤️ 12 👀 2080 📊 4 ⚡