Google 开源 TorchTPU,让 PyTorch 代码可脱离 Nvidia GPU 运行
Google and Amazon now both offer native PyTorch backends that let code leave Nvidia GPUs.
Google 开源 TorchTPU,取代 PyTorch/XLA,让 PyTorch 代码可在 TPU 上运行并逐步调试。此前 TPU 通过 PyTorch/XLA 把操作交给编译器排队执行,调试体验与 GPU 不同;TorchTPU 改为按代码逐操作执行以便调试,生产环境再切换到 torch.compile 提速。原文称 TorchTPU 训练 Qwen 3 8B 时用到最高 52% 的 TPU 峰值算力,并提到 Google 与 Amazon 现在都提供原生 PyTorch 后端。
推荐理由
AI 评分 70
原文给出 TorchTPU 替换 PyTorch/XLA 后的调试方式与训练算力占比,便于判断 TPU 上跑 PyTorch 的实际体验。
主题
正文
当前显示原文,中文全文译文尚未就绪。
Google and Amazon now both offer native PyTorch backends that let code leave Nvidia GPUs.
Google just open-sourced TorchTPU that replaces PyTorch/XLA, letting developers debug TPU models step by step.
TorchTPU used up to 52% of peak TPU compute training Qwen 3 8B.
TPUs previously reached PyTorch through PyTorch/XLA, which queued operations for a compiler, so debugging differed from GPU work.
TorchTPU replaces that layer, running each operation as written for debugging, then switching to torch.compile for production speed.