Understand this story
The English summary is being updated. See the reporting timeline below.
Latest development · Report
UCSD Hao AI Lab Introduces RecSA, Scaling a Model Trained on 32K Sequences to 2M Tokens at Logarithmic CostDevelopments
1 confirmed developments
- Source:UCSD Hao AI Lab
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Nov 19
UCSD Hao AI LabFirst-party
UCSD Hao AI Lab Introduces RecSA, Scaling a Model Trained on 32K Sequences to 2M Tokens at Logarithmic Cost
UCSD Hao AI Lab introduced RecSA, which builds a tree over the KV cache and searches it layer by layer, making the cost per query grow as O(log L) and enabling a model trained only on 32K sequences to extrapolate to 2M tokens. RecSA was initialized from Qwen3-4B and trained on 0.62B tokens. It outperformed all baselines on RULER at context lengths ranging from 131K to 2M, scoring 60.5 at 1M versus 40.0 for the strongest baseline, Dense + DCA. On a single H200, RecSA achieved a 3.2× prefill speedup and a 3.8× decoding speedup at 524K. The project has open-sourced its code, kernels, Qwen3 integration, and evaluation tools.
AI Trends