PyTorch keynote details torch.accelerator, FlexShard and torch_remat
FlexShard's split between storage sharding and compute sharding points to a shift in how PyTorch abstracts distributed memory, potentially simplifying multi-device setups. Engineers running large training jobs or porting to new accelerators can watch the keynote for concrete tooling they can adopt now.
