DeepSeek open-sources the large-scale inference framework DeepInfer under the Apache-2.0 license

DeepSeek has open-sourced the high-performance large-scale inference framework DeepInfer under the Apache-2.0 license. The framework supports optimized kernels, model and sampler runtimes; on parallelism it provides Attention DP, balanced CP, and MoE EP + EPLB, and includes DSpark and confidence scheduling validation, SWA bounded replay, asynchronous scheduling of a zero-overhead batch scheduler, batch-invariant inference, deterministic sampling, and structured output.