Rock Matrix 开源 EdgeRock-4B 文本图像推理模型
Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model with fixed-capacity memory.
Rock Matrix 开源了 EdgeRock-4B，一个带固定容量记忆的小型文本与图像推理模型。该模型把最近 1,024 个 token 完整保留、将较早的重要信息存入单独的记忆库，从而让注意力 KV cache 大小保持固定，避免长对话和长推理持续占用更多 GPU 显存。Rock Matrix 报告其在 AIME 2024–2026 上的平均 pass@1 为 82.9%，其测试的最强有界状态模型为 18.8%。
正文
Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model with fixed-capacity memory.
EdgeRock-4B keeps its attention KV cache fixed in size by holding the last 1,024 tokens in full and saving important older details to a separate bank.
Standard language models keep a growing record of every token they read, so long chats and long reasoning take up more GPU memory over time.
Rock Matrix reports an 82.9% mean pass@1 on AIME 2024–2026, compared to 18.8% for the strongest bounded-state model it tested.