PyTorch 2.15 ships with 3,117 commits and NCCL rewrite
The NCCL rewrite becoming the default signals a maturing distributed-training stack, and NVFP4 decode targets Blackwell-class GPUs that Singapore and ASEAN data centres are actively procuring. Teams running FSDP2 at scale should review the new memory and communication controls before their next training run. Register for the 5 November Q&A to put migration questions directly to the release engineers.
