The Information Machine
Following·Day 2·2 sources

Google and Amazon Release Native PyTorch Backends for Non-Nvidia Hardware

The gist

Developers can now write standard PyTorch code and run it on either Google TPUs or AWS Trainium without relying on Nvidia GPUs. Both integrations lower the barrier to using non-Nvidia accelerators with popular Hugging Face models.

The full picture

Google and Amazon have both released native PyTorch backends that allow ML workloads to run on non-Nvidia hardware. Google open-sourced TorchTPU, a native PyTorch backend for TPUs that replaces the older PyTorch/XLA layer. PyTorch/XLA queued operations for a compiler, making TPU debugging behave differently from GPU workflows; TorchTPU runs operations eagerly for debugging, then switches to torch.compile for production. TorchTPU reached up to 52% of peak TPU compute when training Qwen 3 8B. Separately, Hugging Face announced TorchNeuron, a tool built in collaboration with AWS to reduce the complexity of deploying Hugging Face models on AWS Trainium accelerators.

How it developed
20 October 2026

Google open-sourced TorchTPU, replacing PyTorch/XLA; Amazon also now offers a native PyTorch backend for non-Nvidia hardware

19 October 2026

Hugging Face announced TorchNeuron for running HF models on AWS Trainium

Sources
The daily email

Want this in your inbox?

I send one email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free