Ai2 Releases Olmo-Core 3, Open Training Stack for Trillion-Parameter MoEs

The Allen Institute for AI released Olmo-core 3 on October 1, 2026, an upgrade to its large language model development framework built around a redesigned open mixture-of-experts training system that Ai2 said it has benchmarked at more than one trillion total parameters. Ai2 said Olmo-core 3 is designed to scale MoE training into the trillion-parameter range while preserving computational efficiency, and described it as one of the core systems behind the next generation of Olmo. The release is…

This article has been indexed from Unite.AI

Read the original article: