AITOPAI热报
ProductsSelected

AWS TorchNeuron open sources Trainium PyTorch support

官方账号PyTorch@PyTorch
Post· 2 sources
View the post
Why we picked it

AWS adopting community extension points means Trainium code can look like ordinary PyTorch rather than a separate SDK, lowering the barrier to running training workloads on AWS's own silicon. Teams benchmarking GPU alternatives for cost-sensitive training jobs can now test Trainium without rewriting code. The announcement lands ahead of the PyTorch Conference, where other hardware vendors are expected to show similar integrations.

AWS announced that TorchNeuron will register Trainium as a native PyTorch device, built on the extension points the PyTorch community created for hardware-agnostic development. The open sourcing takes place at the PyTorch Conference on 20 Oct. This gives PyTorch developers direct access to Trainium accelerators through standard PyTorch workflows.

Original · PyTorch

More hardware choice for PyTorch developers: TorchNeuron registers @awscloud Trainium as a native device, built on the same extension points the community created to make PyTorch hardware-agnostic.

Open sourcing at PyTorch Conference on Oct. 20. https://t.co/HpO5M0cUAY https://t.co/YJH1ew2XWN

#PyTorch#AWS#Trainium#TorchNeuron#builders

Keep reading

Recent stories with the same tag or section
ProductsBuildersMulti-sourceSelected04:07
PyTorchCon Demo Theater: 13 Sessions on Training, Inference and Agents

The lineup reveals where the PyTorch ecosystem is concentrating effort: inference speed for video models, MoE expert parallelism on NVL72, and fault-tolerant training that survives link and node failures live. Engineers choosing accelerator backends can use these demos to compare AWS Trainium, Intel AI PCs, TPUs and Rebellions hardware on real workloads. The Huawei CRCR CI relay is also a practical pattern for teams maintaining forks against upstream PyTorch.

#PyTorch#PyTorchCon#Wan 2.2#vLLM
Event
官方账号PyTorch@PyTorch11 sourcesSource
How-toBuildersSelected03:43
PyTorch Examines Linear Algebra Kernels Behind Faster Optimizers

The speed of an optimizer depends as much on kernel-level linear algebra as on step count, a factor most training guides ignore. Engineers tuning large-scale training can apply the QR, Cholesky and eigendecomposition implementation patterns to cut data movement on GPUs. The talk ties directly to GPU MODE's competition, giving concrete reference implementations to study.

#PyTorch#optimizers#GPU#linear algebra
官方账号PyTorch@PyTorchSource
ProductsBuildersSelected02:54
vLLM-TorchTPU brings native PyTorch serving to Google TPUs

The practical effect is that vLLM's optimizations — prefix caching and speculative decoding — now apply to TPU hardware, giving teams a second accelerator option beyond NVIDIA GPUs for self-hosted inference. Organisations already locked into the PyTorch and vLLM stack can evaluate TPU economics without rewriting their serving code. It also signals Google's continued push to open TPU inference beyond JAX.

#vLLM#TPU#PyTorch#Google
官方账号vLLM@vllm_projectSource
ProductsBuildersSelected02:01
FlyDSL kernel DSL now supports PyTorch on AMD MI350 GPUs

AMD MI350 support matters because GPU kernel tooling has historically centred on NVIDIA's stack, and this gives teams serving open models a Python-native path to tune kernels without CUDA-only tools. Benchmark and deployment engineers running vLLM on AMD accelerators can adopt the DSL directly from PyTorch's ecosystem and measure the 3.01x serving gain against their own baselines.

#FlyDSL#PyTorch#AMD#vLLM
官方账号PyTorch@PyTorchSource