Hao AI Lab open-sources the JetSpec++ model, code, and inference engine
On October 31, 2026, the UCSD Hao AI Lab announced that it would fully open-source the JetSpec++ model, code, and inference engine, along with links to the paper, code, and Hugging Face. This speculative decoding framework pipelines draft generation and verification through causal parallel drafting, a hidden-state predictor, and an anchor-token decoder. According to the data it published, on Qwen3-8B, JetSpec++ achieves 1,361 TPS, delivering up to 1.54x end-to-end speedup relative to DSpark and 7.45x relative to autoregressive decoding, while remaining lossless; after combining NVFP4 with kernel optimizations, on two GB200 GPUs, Qwen3-8B exceeds 4,000 TPS and Qwen3.8-27B exceeds 900 TPS. There are currently no further developments.
On October 31, 2026, the UCSD Hao AI Lab announced that it would fully open-source the JetSpec++ model, code, and inference engine, along with links to the paper, code, and Hugging Face. This speculative decoding framework pipelines draft generation and verification through causal parallel drafting, a hidden-state predictor, and an anchor-token decoder. According to the data it published, on Qwen3-8B, JetSpec++ achieves 1,361 TPS, delivering up to 1.54x end-to-end speedup relative to DSpark and
Matched fieldsSummary
