University of Texas paper proposes Jev-Mem memory system

Oct 25

1. 22:27

   Rohan Paul

   University of Texas paper proposes Jev-Mem: long-conversation memory construction 6.6x faster

   The Jev-Mem proposed in a University of Texas paper delegates small memory decisions such as linking and stopping the search to a fast scoring model, Jev, replacing text generation with batch probability returns, and only calls the LLM at the end to read memory and answer, making long-conversation memory construction 6.6x faster. On the LoCoMo long-conversation benchmark, its answer score is 0.777, higher than the best baseline's 0.700; memory construction takes 158 seconds versus 1,044 seconds for the fastest comparison method, and answering takes 0.93 seconds versus 1.47 seconds for the comparison method. The authors suggest that if a memory pipeline calls an LLM for routing, scoring, or stop decisions, it can switch to a fast classifier and reserve the LLM for the final answer.

   Expand summary