腾讯混元开源了Hy4预览版，1M上下文+770B参数，在真实任务评测中超越GLM和Kimi
腾讯混元开源Hy4预览版，这是一款旗舰级MoE模型，拥有1M上下文长度。该模型总参数量770B，每激活49B参数。在163位内部专家对203个真实工程任务的盲评中，Hy4平均得分2.99，略高于GLM 5.3(2.92)和Kimi K3(2.94)。模型基于真实生产工作流训练，涵盖软件工程、办公、数据分析和科研等领域。
🤝
🤝 ModelScope @ModelScope2022 Tencent HY open-sourced Hy4 preview: a flagship MoE with 1M context, and their biggest generational leap measured to date. Apache 2.0.🔥 � modelscope.cn/models/Tencent… AC ⚙️ 770B total params, 49B active per token. Ships with a native MTP layer for speculative decoding out of the box. 📊 Blind eval by 163 internal experts across 203 real engineering tasks: it edges out GLM 5.3 (avg 2.99 vs 2.92) and Kimi K3 (2.99 vs 2.94). 💼 Trained on real production workflows: software engineering, office and data analysis, game development, and scientific research. 🌍 For global us modelscope.ai/models/Tencent… OFpfV 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 10 👀 959 📊 1 ⚡