AllenAI launches Olmo-core 3
This open-source infrastructure democratizes access to MoE model training, potentially accelerating research beyond well-funded labs. Developers and researchers can now experiment with MoE architectures without massive resource requirements, though they'll still need significant GPU clusters for full-scale training.