MemTensor Open-Sources Native Memory Model MemT-1.0, Available in 36B and 288B Tiers
The MemTensor team has open-sourced MemT-1.0, a model built on a native memory architecture, offering two size tiers—36B Nano and 288B Flash—and has released a 66-page technical report. The model connects a Native Memory Block in parallel alongside the standard Transformer Block, uses an erase gate, write gate, and forget gate to achieve token-level dynamic state updates, and extends memory capacity through a Mixture-of-Storage mechanism. According to the figures in the article, under a 256K history, VRAM drops from 5.06 GiB to 40 MiB, and first-token latency remains at 104–112 ms between 512 and 256K.
e tiers—36B Nano and 288B Flash—and has released a 66-page technical report. The model connects a Native Memory Block in parallel alongside the standard Transformer Block, uses an erase gate, write gate, and forget gate to achieve token-level dynamic state updates, and extends memory capacity through a Mixture-of-Storage mechanism. According to the figures in the article, under a 256K history, VRAM drops from 5.06 GiB to 40 MiB, and first-token latency remains at 104–112 ms between 512 and 256K.
Matched fieldsSummary、Body