Thinking Machines开源了975B参数的MoE模型Inkling，支持多模态和64K/256K长上下文，还能在Tinker上微调，值得试试。
Thinking Machines推出Inkling，一个975B参数（41B活跃）的MoE Transformer模型。它原生支持文本、图像和音频多模态处理。上下文长度提供64K和256K两种版本。完整权重已开放，可在Tinker平台进行微调。用户还能通过Inkling Playground直接体验。
Never too late for any company to get in on open models. Inkling is a MoE transformer with 975B (41...
Never too late for any company to get in on open models. Inkling is a MoE transformer with 975B (41B active). Native multimodal support. Context lengths: 64K and 256K. Will be testing and providing thoughts soon. Thinking Machines @thinkymachines Today, we are introducing Inkling. Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available. thinkingmachines.ai/news/introduci… Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵 🔗 View Quoted Tweet 💬 5 🔄 4 ❤️ 15 👀 2259 📊 6 ⚡