Google open-sources TorchTPU native PyTorch stack
Google collaborated with Meta's PyTorch team to launch the open-source project TorchTPU, providing a native PyTorch backend for Google TPU; migration only requires changing model.to("cuda") to model.to("tpu"). The project supports both eager and torch.compile modes, adds a new DeferAndFuse eager mode, covers about 450 Aten operators, and has been verified to run out of the box on 4,917 Hugging Face models, with a Tier 1 pass rate of 98% and Tier 2 numerical consistency relative to GPU of 97%. The official statement says it has been used in the inference and training production workloads of some Google Cloud major customers, and is integrated with vLLM, SGLang, TorchTitan, Ray, and TorchRec. Subsequent reports said that at PyTorch Conference North America 2026, Google open-sourced TorchTPU, whose runtime no longer depends on JAX, and existing workloads can be migrated with only minor code changes; PyTorch noted that TorchTPU's default Skinny Collectives scheme suffers roughly 30–40% end-to-end performance loss under distributed workloads compared with optimized schemes, and achieving peak performance still requires Pallas kernels and vLLM-T
Google collaborated with Meta's PyTorch team to launch the open-source project TorchTPU, providing a native PyTorch backend for Google TPU; migration only requires changing model.to("cuda") to model.to("tpu"). The project supports both eager and torch.compile modes, adds a new DeferAndFuse eager mode, covers about 450 Aten operators, and has been verified to run out of the box on 4,917 Hugging Face models, with a Tier 1 pass rate of 98% and Tier 2 numerical consistency relative to GPU of 97%. Th
Matched fieldsSummary