DeepSeek 以 Apache-2.0 协议开源大规模推理框架 DeepInfer
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.
DeepSeek 以 Apache-2.0 协议开源了高性能大规模推理框架 DeepInfer。该框架支持优化后的 kernel、模型与采样器运行时，并行方面提供 Attention DP、balanced CP 以及 MoE EP + EPLB，并包含 DSpark 与置信度调度验证、SWA bounded replay、零开销批调度器的异步调度、批不变推理、确定性采样和结构化输出。
正文
当前显示原文，中文全文译文尚未就绪。
DeepSeek just open sourced its high-performance, large-scale inference framework DeepInfer in Apache-2.0 license.
Supported features:
- Optimized kernels, model and sampler runtime - Parallelism: Attention DP / balanced CP, MoE EP + EPLB - DSpark and confidence-scheduled verification - SWA bounded replay - Asynchronous scheduling (zero-overhead batch scheduler) - Batch-invariant inference - Deterministic sampling - Structured output