AllenAI launches Olmo-core 3
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
This open-source infrastructure democratizes access to MoE model training, potentially accelerating research beyond well-funded labs. Developers and researchers can now experiment with MoE architectures without massive resource requirements, though they'll still need significant GPU clusters for full-scale training.
AllenAI has released Olmo-core 3, an open and scalable training infrastructure for large Mixture of Experts (MoE) models.
The system supports parallel training across thousands of GPUs and has demonstrated superior performance on multiple benchmarks.
Olmo-core 3 features a modular design that enables researchers to flexibly build and customize large language models.
This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Olmo-core, AllenAI, MoE, large model training.
Primary source verification: published directly by Hugging Face: Blog with first-party authority.