Google open-sourced TorchTPU, replacing PyTorch/XLA; Amazon also now offers a native PyTorch backend for non-Nvidia hardware
Google and Amazon Release Native PyTorch Backends for Non-Nvidia Hardware
Developers can now write standard PyTorch code and run it on either Google TPUs or AWS Trainium without relying on Nvidia GPUs. Both integrations lower the barrier to using non-Nvidia accelerators with popular Hugging Face models.
The full picture
Google and Amazon have both released native PyTorch backends that allow ML workloads to run on non-Nvidia hardware. Google open-sourced TorchTPU, a native PyTorch backend for TPUs that replaces the older PyTorch/XLA layer. PyTorch/XLA queued operations for a compiler, making TPU debugging behave differently from GPU workflows; TorchTPU runs operations eagerly for debugging, then switches to torch.compile for production. TorchTPU reached up to 52% of peak TPU compute when training Qwen 3 8B. Separately, Hugging Face announced TorchNeuron, a tool built in collaboration with AWS to reduce the complexity of deploying Hugging Face models on AWS Trainium accelerators.
How it developed
Hugging Face announced TorchNeuron for running HF models on AWS Trainium
Sources
Want this in your inbox?
I send one email each morning with the stories that moved. If you would rather just read here, that works too.
Subscribe free