Baidu Open-Sources ERNIE 5.5 Flash Base: A 280B MoE Model with 14B Active Parameters and 1M Context Support
Baidu has open-sourced ERNIE 5.5 Flash Base, a 280B-parameter MoE model with only 14B active parameters, pretrained on 33.5T tokens. The model performs strongly on reasoning, coding, and long-context benchmarks, supports up to 1M context, and post-training is already underway. Baidu's official account reposted the release and said there will be more to come.
Why read this
AI score 72
ERNIE 5.5 Flash Base is open-sourced with 280B total parameters, 14B active parameters, and a 1M context, which indicates its positioning in reasoning and coding.
Topics
View original postExcited to introduce ERNIE 5.5 Flash Base, my first release since joining @Baidu_Inc ! An open-sourced 280B MoE model with just 14B active parameters, pretrained on 33.5T tokens. It delivers strong performance across reasoning, coding, and long-context benchmarks, with support for up to 1M context. Huge respect and thanks to the incredible team behind this — outstanding work! Post-training is already underway, and I can't wait to bring it to you soon. And this is just the beginning — more exciting technical developments are on the way. Stay tuned! https://t.co/7DBNYNwf81
View original
Excited to introduce ERNIE 5.5 Flash Base, my first release since joining @Baidu_Inc ! An open-sourced 280B MoE model with just 14B active parameters, pretrained on 33.5T tokens. It delivers strong performance across reasoning, coding, and long-context benchmarks, with support for up to 1M context. Huge respect and thanks to the incredible team behind this — outstanding work! Post-training is already underway, and I can't wait to bring it to you soon. And this is just the beginning — more exciting technical developments are on the way. Stay tuned! https://t.co/7DBNYNwf81
Body
Stay tuned for more!