搞深度学习的都该看看:PyTorch 官方在中国办的线下活动,12月12日北京,全天免费。和自己在网上看文档不同,能直接听到框架新版本特性和一线团队的实践经验,名额有限得先注册。
#deep learning frameworks
The NCCL rewrite becoming the default signals a maturing distributed-training stack, and NVFP4 decode targets Blackwell-class GPUs that Singapore and ASEAN data centres are actively procuring. Teams running FSDP2 at scale should review the new memory and communication controls before their next training run. Register for the 5 November Q&A to put migration questions directly to the release engineers.
PyTorch users no longer need vendor-specific forks or heavy rewrites to move training and inference onto TPUs, which lowers the barrier to diversifying GPU-heavy fleets. Engineers evaluating TPU capacity against NVIDIA GPU costs can now test portability with their existing codebase. Google's own stack gains a smoother on-ramp for the PyTorch ecosystem's massive installed base.
FlexShard's split between storage sharding and compute sharding points to a shift in how PyTorch abstracts distributed memory, potentially simplifying multi-device setups. Engineers running large training jobs or porting to new accelerators can watch the keynote for concrete tooling they can adopt now.
PyTorch 生态年度大会开幕了,vLLM、Ray、DeepSpeed 这些项目都有专场,不到场也能看直播,做工程的同学可以挑几场听。