Eagle Corp 开源 EAGLE-4 灵活 drafter，加速 LLM 推理
Eagle Corp released EAGLE-4, its latest open-source flexible drafter, for accelerating LLM inference.
Eagle Corp 发布开源灵活 drafter EAGLE-4，用于加速 LLM 推理。其核心是同一个 drafter 会根据 batch size、硬件和工作负载调整投机解码策略，并保持目标模型的输出分布。实测中 Qwen3.8-27B 搭配 EAGLE-4 draft 在 4 张 NVIDIA B300 上达到 961.6 tokens/s。
查看原帖EAGLE-4 is here. From EAGLE-1 to EAGLE-3, we’ve kept making inference faster. EAGLE-4 is our fastest yet. 961.6 tokens/s on @Alibaba_Qwen’s Qwen3.8-27B with TokenSpeed (BF16, 4× @NVIDIA B300, TP4, one request, T=0). Github: https://t.co/GwocZk1UTU https://t.co/GawgFNXKWj
正文
当前显示原文，中文全文译文尚未就绪。
Eagle Corp released EAGLE-4, its latest open-source flexible drafter, for accelerating LLM inference.
> At its core, “One drafter adapts its speculative decoding strategy to the batch size, the hardware, and the workload, and keeps the target model's output distribution.”
> Qwen3.8-27B with its EAGLE-4 draft is the measured target pair, achieving 961.6 tokens/s while running on 4x NVIDIA B300.
Eagle is an AI inference platform that powers leading companies like NVIDIA, Meta, Intel, AMD, and Perplexity.
Inference testing time 👀