#deep learning frameworks

6 stories · 1 in 7 days · 6 in 30 days
Stories, products and papers tagged "deep learning frameworks", newest first.
Nov 16
Oct 29
ProductsBuildersMulti-sourceSelected71°01:52
PyTorch 2.15 ships with 3,117 commits and NCCL rewrite

The NCCL rewrite becoming the default signals a maturing distributed-training stack, and NVFP4 decode targets Blackwell-class GPUs that Singapore and ASEAN data centres are actively procuring. Teams running FSDP2 at scale should review the new memory and communication controls before their next training run. Register for the 5 November Q&A to put migration questions directly to the release engineers.

Event
Official accountPyTorch@PyTorchSource
Oct 23
Oct 22
ProductsBuildersSelected01:25
TorchTPU brings out-of-the-box PyTorch execution on TPUs

PyTorch users no longer need vendor-specific forks or heavy rewrites to move training and inference onto TPUs, which lowers the barrier to diversifying GPU-heavy fleets. Engineers evaluating TPU capacity against NVIDIA GPU costs can now test portability with their existing codebase. Google's own stack gains a smoother on-ramp for the PyTorch ecosystem's massive installed base.

Official accountPyTorch@PyTorchSource
Oct 21
ProductsBuildersSelected00:35
PyTorch keynote details torch.accelerator, FlexShard and torch_remat

FlexShard's split between storage sharding and compute sharding points to a shift in how PyTorch abstracts distributed memory, potentially simplifying multi-device setups. Engineers running large training jobs or porting to new accelerators can watch the keynote for concrete tooling they can adopt now.

Official accountPyTorch@PyTorchSource