Ant Ling 3.1 Flash Enters the First Batch of Models Supported by SGLang-TorchTPU
Ant Ling said that Ling 3.1 Flash and the Ling 3.0 series have entered the SGLang-TorchTPU launch lineup. SGLang said the plugin was built jointly by SGLang, the Google TPU team, and the Meta PyTorch team, and is already used in Meta's production inference; the first batch of supported open models also includes Muse Spark Open, GLM-5.3 Flash, Kimi K3, and MiniMax H3.
Why read this
AI score 56
SGLang-TorchTPU brings native PyTorch serving to TPU, with Ling 3.1 Flash and other models entering the first batch of supported models, offering a window into hardware choices for MoE inference.
Topics
View original postToday we launch SGLang-TorchTPU, built with @Google TPU team and Meta @PyTorch team. We’re excited to see it powering production inference at Meta! SGLang-TorchTPU is a TPU plugin for SGLang that brings: - Top open models on TPU: Muse Spark Open, GLM-5.3 Flash, Kimi K3, Ling 3.1 Flash, MiniMax H3 - SGLang’s production features for large agentic workloads - Custom MegaKernel: Muse Spark Open hits 770 tok/s decode at bs=1 on InferenceX 8K/1K SGLang-TorchTPU is available now: https://t.co/ix02YggKGG
View original
Today we launch SGLang-TorchTPU, built with @Google TPU team and Meta @PyTorch team. We’re excited to see it powering production inference at Meta! SGLang-TorchTPU is a TPU plugin for SGLang that brings: - Top open models on TPU: Muse Spark Open, GLM-5.3 Flash, Kimi K3, Ling 3.1 Flash, MiniMax H3 - SGLang’s production features for large agentic workloads - Custom MegaKernel: Muse Spark Open hits 770 tok/s decode at bs=1 on InferenceX 8K/1K SGLang-TorchTPU is available now: https://t.co/ix02YggKGG
Body
Excited to see Ling 3.1 Flash and the Ling 3.0 family in the SGLang-TorchTPU launch lineup! Thanks @sgl_project, Google and Meta for bringing PyTorch-native serving to TPUs—expanding hardware choice for efficient MoE inference and agentic workloads.