Meta出了个30B开源模型Muse Glimmer，支持12万上下文，单卡每秒跑2万token，还能在Mac上本地跑。
Meta发布Muse Glimmer，一个300亿参数的开放权重密集模型，上下文窗口超过12万token。该模型针对长时间运行的智能体任务优化，在单张GPU上可实现每秒2万token的推理速度。模型权重以Apache 2.0许可证发布，可在Mac或配备高性能GPU的PC上本地运行，并已针对NVIDIA边缘、桌面和工作站平台优化。
Great to see @AIatMeta back publishing open models 🙌 Muse Glimmer is a 30B open-weight dense model...
Great to see @AIatMeta back publishing open models 🙌 Muse Glimmer is a 30B open-weight dense model with a 120K+ context window, built for long-running agents, delivering up to 20K tokens/sec on a single GPU. It’s optimized to run locally across NVIDIA edge, desktop, and workstation AI platforms. Try it with our GPU-accelerated endpoint: nvda.ws/45ehAYe L AI at Meta @AIatMeta Introducing Muse Glimmer, an open-weight 30B-parameter model optimized for local, always-on agent workflows. Muse Glimmer delivers strong performance on key agentic use cases and benchmarks compared with leading models in its size category, and is designed to run entirely on consumer hardware like a Mac or PCs with performant GPUs. In keeping with our long tradition of sharing fundamental AI research, we’re releasing model weights under a permissive Apache 2.0 license. 🧵👇 🔗 View Quoted Tweet 💬 2 🔄 2 ❤️ 21 👀 2270 📊 4 ⚡
- ollama11:49原文