ModelsOfficialSelected

AllenAI launches Olmo-core 3

Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs

Why we picked it

This open-source infrastructure democratizes access to MoE model training, potentially accelerating research beyond well-funded labs. Developers and researchers can now experiment with MoE architectures without massive resource requirements, though they'll still need significant GPU clusters for full-scale training.

AllenAI has released Olmo-core 3, an open and scalable training infrastructure for large Mixture of Experts (MoE) models.

Image · Hugging Face: Blog
Body

The system supports parallel training across thousands of GPUs and has demonstrated superior performance on multiple benchmarks.

Olmo-core 3 features a modular design that enables researchers to flexibly build and customize large language models.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Models" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows and US-China foundation model benchmarks and commercialization comparison. Key entities and technical topics under continuous tracking include Olmo-core, AllenAI, MoE, large model training.

Primary source verification: published directly by Hugging Face: Blog with first-party authority.