Tag: beyond context compression

Beyond context compression explained — what it is, how it works and what it costs. Below are 1 article about beyond context compression on CheapToken News.

Beyond context compression, the Shanghai AI Laboratory open-sources REMORY—a 1.9B-parameter memory module that enables small models to work independently for three days and produce output on par with GPT-6.1-Terra.

April 21, 2018 | 机器之心
Beyond context compression, the Shanghai AI Laboratory open-sources REMORY—a 1.9B-parameter memory module that enables small models to work independently for three days and produce output on par with GPT-6.1-Terra.
After Apex-35B-V1.0 attracted attention for outperforming Flint, the open-source RSI model ecosystem received another impressive result: REMORY achieved fully self-supervised training using only a 1.9B memory module and two H800 GPUs, taking the lead in several key benchmarks; it drove a small model to recursively improve for several days, producing results close to GPT-6.1-Terra.The paper’s first author, Xia Hanchen, is a researcher at the Shanghai Instit

Related articles