DeepSeek Open-Sources Inference Framework DeepInfer; AI-Written ForgeKernel Tops Operator Benchmark in the Same Week
DeepSeek recently fully open-sourced its inference framework DeepInfer, further opening up the model execution pipeline after the model weights and operator libraries such as FlashMLA and DeepGEMM. As of October 22, ForgeKernel—entirely written by AI with no manual line-by-line tuning—simultaneously topped the NVIDIA SOL-ExecBench FlashInfer-Bench combined leaderboard and the Ascend CANNBench A3 hardware leaderboard, with a benchmark speedup of 1.835×, 25% ahead of the runner-up. On the operators for DeepSeek v4.1 Flash, ForgeKernel, built from scratch through AI iteration, outperformed the NVIDIA version open-sourced by DeepSeek.
#Industry news#Open-source ecosystem#English text is being prepared.