LiquidAI 发布端侧推理智能体模型 LFM2.5-24B-A2B
Run fast, private agents on-device with LFM2.5-24B-A2B
LiquidAI 发布 LFM2.5-24B-A2B，基于 LFM2-24B-A2B 架构，激活参数 2B，上下文窗口从 32K 扩至 131K tokens，词表从 65K 扩至 128K，并改为只输出思维链的推理模型。预训练规模从约 17T 扩至约 33T tokens，后训练经 SFT、教师专精、两阶段多领域在线策略蒸馏和智能体强化学习五步，在 OpenClaw、Hermes Agent、Pi、OpenCode 等框架内训练。在 16 项基准中，它在 AutomationBench、BFCLv4、ToolSandbox、LiveClaw、τ³-Bench Banking 等 8 项工具与智能体基准中的 5 项领先或持平，三项指令遵循基准全部领先，但 GPQA Diamond、HLE、SWE-Bench Verified 等知识密集与编码基准仍落后于更大模型。模型已在 Hugging Face 开源权重，支持 llama.cpp、MLX、vLLM、SGLang、ONNX，在 M5 Max 上解码 184 tokens/s，单张 B300 高并发下输出超 21K tokens/s。
正文
当前显示原文，中文全文译文尚未就绪。
How we built a reasoning agent with 2B active parameters
LFM2.5-24B-A2B builds on LFM2-24B-A2B and keeps its architecture: 40 layers, 64 experts per MoE block with top-4 routing, and the same hybrid of gated short convolutions and GQA. The context window grows from 32K to 131K tokens, and an in-place tokenizer expansion doubles the vocabulary from 65K to 128K tokens for better non-Latin tokenization. Unlike its predecessor, it is a reasoning-only model that produces an explicit chain of thought before its final answer.
Pre-training was scaled up from ~17T to ~33T tokens. Mid-training then adds 2T tokens at 32K context, weighted toward reasoning, math, code, instruction following, and multilingual text, and 300B tokens at 131K context, weighted toward long-context data. Tool calls and multi-turn trajectories appear throughout both phases. Post-training turns the base model into an agent in five stages:
Supervised fine-tuning (SFT)
Teacher specialization
Multi-domain on-policy distillation (MOPD), non-agentic: distill the specialist teachers on non-agentic tasks.
MOPD, agentic: a second distillation stage focused on agentic tasks.
Agentic reinforcement learning (Agentic RL): train the model inside agent harnesses, such as OpenClaw , Hermes Agent , Pi , and OpenCode .
Benchmark results
We evaluated LFM2.5-24B-A2B against Qwen3.6-35B-A3B, Gemma-4-26B-A4B-it, and Nemotron-3.5-Lightning on 16 benchmarks covering tool use and agentic workflows, knowledge, instruction following, math, and coding. It is the smallest model in the group, yet it is competitive with MoEs with ~50% more total and active parameters.
*All the models were evaluated with vLLM, using each benchmark's recommended generation parameters.
For your app, the strengths are tool use and instruction following. LFM2.5-24B-A2B leads or matches the competition on five of the eight tool-use and agentic benchmarks (AutomationBench, BFCLv4, ToolSandbox, LiveClaw, and τ³-Bench Banking), and on AutomationBench it scores more than three times the next-best model. It also leads on all three instruction-following benchmarks. Larger models keep an edge on knowledge-heavy benchmarks like GPQA Diamond, HLE, and AA-Omniscience, and on coding benchmarks like SWE-Bench Verified (OpenCode) and SciCode, so pair LFM2.5-24B-A2B with retrieval or web search for knowledge-heavy workloads.
These results make LFM2.5-24B-A2B a strong foundation for agents that need to reason, call tools, and run reliably on your device.
Inference speed on CPU and GPU
LFM2.5-24B-A2B ships with day-one support across the inference ecosystem, including llama.cpp, MLX, vLLM, SGLang, and ONNX.
Edge inference. LFM2.5-24B-A2B is the fastest of the compared MoEs, decoding 184 tokens/s on an M5 Max and 114 tokens/s on a Ryzen AI Max+ 395. That is up to 1.7x faster than the next-best model, while using the least memory.
GPU inference. LFM2.5-24B-A2B is the fastest model in its size class, reaching over 21K output tokens per second at high concurrency on a single B300.
How to use LFM2.5-24B-A2B
Reach for LFM2.5-24B-A2B when you need agents that reason, call tools, and run reliably on your device.
Install the latest version of transformers (compatible with transformers>=5.0.0 ):
Then load and run the model:
Use it in your agent harness
Serve LFM2.5-24B-A2B locally behind any OpenAI-compatible backend, then point your agent harness at it. For example, with Hermes Agent:
The port depends on your serving backend: llama.cpp and MLX use 8080 , vLLM uses 8000 , SGLang uses 30000 , and LM Studio uses 1234 . See the model card for OpenClaw and Pi configs, and our guide for the full setup. Check out our release blog for video examples.
Both LFM2.5-24B-A2B and LFM2.5-24B-A2B-Base are open-weight and available on Hugging Face today:
Download: LFM2.5-24B-A2B-Base and LFM2.5-24B-A2B on Hugging Face.
Use in your harness: follow our guide on how to run a local agent, like OpenClaw, Hermes Agent, and Pi.
Fine-tune: adapt LFM2.5-24B-A2B to your task with our fine-tuning tutorials .
We can't wait to see what you build.
Citation
If you use this work, please cite the release blog:
Models mentioned in this article 3
LiquidAI/LFM2-24B-A2B
LiquidAI/LFM2.5-24B-A2B
LiquidAI/LFM2.5-24B-A2B-Base
More from this author
Multimodal open d1 decision models for the edge
Accelerating vision-language models with LFM2.5-VL-DSpark
Models mentioned in this article 3
LiquidAI/LFM2-24B-A2B
LiquidAI/LFM2.5-24B-A2B
LiquidAI/LFM2.5-24B-A2B-Base