腾讯开源了Hy3，295B MoE模型只激活21B参数，性能就能跟更大模型比。OpenRouter上免费试用到7月21日，赶紧去玩玩。
腾讯Hy团队发布Hy3模型，这是一个295B参数MoE架构，激活参数为21B，MTP层参数3.8B。Hy3在多项基准测试中超越同尺寸模型，并媲美2-5倍参数的开源旗舰模型。该模型支持256K上下文长度，FP8量化版本大小为300GB。目前Hy3在OpenRouter上免费开放至2026年7月21日。
tencent/Hy3
tencent/Hy3 New Apache 2.0 licensed model from Tencent in China: Hy3 is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+ products and scaled up post-training with higher quality data. Today, we introduce Hy3, which outperforms similar-size models and rivals flagship open-source models with 2-5x parameters. It also shows significant gains in utility across various products and productivity tasks. The full-sized model is 598GB on Hugging Face, and the FP8 quantized one is 300GB . The context length is 256K. It's available for free on OpenRouter until July 21st . I had it "Generate an SVG of a pelican riding a bicycle" there and got this: Tags: ai , generative-ai , llms , pelican-riding-a-bicycle , llm-release , ai-in-china