Poolside开源了Laguna S 2.1，118B参数只要8B激活就能跑，单卡DGX Spark就能用，还能和超大模型正面刚！
Poolside发布Laguna S 2.1，一款118B总参数的Mixture-of-Experts模型，每token仅激活8B参数。支持1M上下文窗口，提供thinking和no-thinking两种模式。模型从训练到发布不到9周，权重完全开源在Hugging Face，可在单个NVIDIA DGX Spark上运行。其性能可匹敌参数规模大数倍的模型。
Open weight models galore! Laguna S 2.1 went from the start of training to launch in under 9 weeks!...
Open weight models galore! Laguna S 2.1 went from the start of training to launch in under 9 weeks! Custom & open models are putting a lot of pressure on the frontier closed and general models. No wonder they want to ban them. Diverse intelligence is good for the market. Poolside @poolsideai Today we're releasing Laguna S 2.1, our most capable model to date. It's a 118B total parameter Mixture-of-Experts model with 8B activated per token, a context window of up to 1M tokens, and thinking and no-thinking modes. Capable enough to hold its own against models many times its size. Small enough to run on a single @NVIDIAAI DGX Spark. Laguna S 2.1 is fully open under OpenMDW-1.1, with weights available today on @huggingface poolside.ai/blog/introduci… Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 1 🔄 3 ❤️ 6 👀 1392 📊 2 ⚡