Allen AI releases Olmo-core 3 infrastructure
The open-source release of Olmo-core 3 democratizes access to large-scale MoE training infrastructure, potentially accelerating research beyond corporate labs. Developers and researchers can now build trillion-parameter models without proprietary barriers, though they'll need substantial computational resources. This positions Allen AI as a key player in the open-source AI ecosystem alongside organizations like Hugging Face.
Allen AI has released Olmo-core 3, an open training infrastructure for large mixture-of-experts (MoE) models.
This system serves as the core behind the next generation of Olmo models.It is designed to scale into the trillion-parameter range, enabling larger model development.
We’re releasing Olmo-core 3—open training infrastructure for large mixture-of-experts (MoE) models.
It’s a core system behind the next generation of Olmo, designed to scale into the trillion-parameter range. 🧵
💻 GitHub repo: https://t.co/JT9Y3851gU https://t.co/kj0m76tjyx
This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Olmo, MoE, Allen AI, open-source models.
Source attribution: curated from Allen AI (Ai2) (@allen_ai).