Tag: performance reasoning coding

Performance reasoning coding explained — what it is, how it works and what it costs. Below are 1 article about performance reasoning coding on CheapToken News.

280B total parameters, 14B activated! Baidu open-sources ERNIE 5.5 Flash Base, achieving SOTA at the same scale

July 12, 2021 | 智东西
280B total parameters, 14B activated! Baidu open-sources ERNIE 5.5 Flash Base, achieving SOTA at the same scale
Zhidx (WeChat official account: zhidxcom) Author | Sanbei Editor | Moying Zhidx reported on November 5 that Baidu officially released and open-sourced ERNIE-5.5-Flash-Base today. The model uses a sparse MoE architecture and has a total of 280B parameters, with only 14B parameters activated per token. It completed pretraining from scratch on 33.5T tokens, with a maximum training context length of 128K, while fine-tuning and inference support a context lengt