SemiAnalysis benchmarks Trainium3's PyTorch training and Neuron Explorer profiler
The SemiAnalysis engineering team benchmarked the native PyTorch training stack TorchNeuron and TorchTitan on Trainium3, training Qwen3-32B on 16 Trainium2 chips; eager mode reached 11,099 tokens/s and 23.89% MFU, while compiled mode reached 14,156 tokens/s and 30.47% MFU. The author considers the Neuron Explorer profiler superior to Nvidia's and AMD's solutions, but first-time compilation takes too long: the first-step compilation for the gpt-oss training recipe took 27 minutes 17 seconds. FlexAttention tests passed 89 of 96 cases, with all 7 failures due to compilation timeouts rather than numerical errors.
The SemiAnalysis engineering team benchmarked the native PyTorch training stack TorchNeuron and TorchTitan on Trainium3, training Qwen3-32B on 16 Trainium2 chips; eager mode reached 11,099 tokens/s and 23.89% MFU, while compiled mode reached 14,156 tokens/s and 30.47% MFU. The author considers the Neuron Explorer profiler superior to Nvidia's and AMD's solutions, but first-time compilation takes too long: the first-step compilation for the gpt-oss training recipe took 27 minutes 17 seconds. Flex
Matched fieldsBody


