OpenBMB Open-Sources ForgeKernel: DeepSeek V4.1 Prefill Kernel 9.8% Faster
OpenBMB announced the open-sourcing of ForgeKernel; its agent completed 42 iterations in about 22 hours and produced 32 kernel versions, ultimately achieving 1.098x performance on the DeepSeek V4.1 FlashMLA Prefill on an NVIDIA B200, at 472 µs versus the 518 µs baseline. The official FlashMLA implementation remained closed throughout; the agent could only run and time its black-box CLI and could not read source code, documentation, or profiling data. The open-sourced content includes the optimized DeepSeek V4.1 fused prefill kernel, the kernels from the paper covering attention, Gated DeltaNet, Kimi Delta Attention, GEMM, and convolution, as well as the ForgeKernel harness that can be used to optimize one's own kernels; across 27 operators, ForgeKernel matched or outperformed 18 of 22 expert-library kernels and outperformed all 7 kernels published by three kernel-generation systems.
rgeKernel; its agent completed 42 iterations in about 22 hours and produced 32 kernel versions, ultimately achieving 1.098x performance on the DeepSeek V4.1 FlashMLA Prefill on an NVIDIA B200, at 472 µs versus the 518 µs baseline. The official FlashMLA implementation remained closed throughout; the agent could only run and time its black-box CLI and could not read source code, documentation, or profiling data. The open-sourced content includes the optimized DeepSeek V4.1 fused prefill kernel, th
Matched fieldsSummary、Body
