MiniMax responds to H3 integration with TPU: looking forward to open-source work on efficient video inference
MiniMax officially responded to SGLang adding MiniMax H3 to the TPU support list of SGLang-TorchTPU, and said it looks forward to more open-source work on efficient video inference. SGLang said that SGLang-TorchTPU was built jointly by SGLang, the Google TPU team, and the Meta PyTorch team, has been used for production inference at Meta, and supports models including Muse Spark Open, GLM-5.3 Flash, Kimi K3, Ling 3.1 Flash, and MiniMax H3.
Why read this
AI score 58
MiniMax responded to SGLang-TorchTPU adding H3 to its TPU inference support, offering a look at the deployment progress of open-source video models on TPU.
Topics
View original postToday we launch SGLang-TorchTPU, built with @Google TPU team and Meta @PyTorch team. We’re excited to see it powering production inference at Meta! SGLang-TorchTPU is a TPU plugin for SGLang that brings: - Top open models on TPU: Muse Spark Open, GLM-5.3 Flash, Kimi K3, Ling 3.1 Flash, MiniMax H3 - SGLang’s production features for large agentic workloads - Custom MegaKernel: Muse Spark Open hits 770 tok/s decode at bs=1 on InferenceX 8K/1K SGLang-TorchTPU is available now: https://t.co/ix02YggKGG
View original
Today we launch SGLang-TorchTPU, built with @Google TPU team and Meta @PyTorch team. We’re excited to see it powering production inference at Meta! SGLang-TorchTPU is a TPU plugin for SGLang that brings: - Top open models on TPU: Muse Spark Open, GLM-5.3 Flash, Kimi K3, Ling 3.1 Flash, MiniMax H3 - SGLang’s production features for large agentic workloads - Custom MegaKernel: Muse Spark Open hits 770 tok/s decode at bs=1 on InferenceX 8K/1K SGLang-TorchTPU is available now: https://t.co/ix02YggKGG
Body
Thank you for bringing H3 to TPUs! Excited to see more open-source work on efficient video inference and what it could enable: faster creative iteration, new interactive experiences, and more ways for developers to build with H3.