Introducing OLMo-Core 3: Open Scalable Training Infrastructure for Large MoEs

Allen Institute for AI has released OLMo-Core 3, an open training framework specifically engineered for large Mixture-of-Experts models, now available on Hugging Face. The release includes modular components for distributed training, routing strategies, and checkpointing that are designed to scale to frontier model sizes while remaining auditable and reproducible. For researchers and teams training their own MoE architectures, OLMo-Core 3 provides a reference implementation that is explicitly open and inspectable — a meaningful alternative to closed training stacks. The framework integrates with existing HuggingFace tooling, lowering the barrier for adoption within the open-source research community. This is particularly relevant as MoE architectures become the default choice for state-of-the-art open models.