训练模型自己动手写 GPU 适配代码,3 天搞定以前要半年到一年的活,这事发生在 Anthropic 身上。CUDA 锁定效应第一次被正面动摇,做算力采购和基础设施的人都该看看这份路演材料。
#AMD MI355X
Zyphra 开源了 MI355X 上的 FP8 attention 内核,比 AMD 官方 AITER 最快快 1.76 倍,误差还更低,搞 AMD 推理的可以看看。
The engineering details on keeping long agent trajectories and hundreds of CPU sandboxes from stalling RL training are the real payload here, not the headline score. Teams building agentic RL pipelines can study how SGLang, Megatron-LM and Harbor were combined on AMD hardware as an alternative to NVIDIA-only stacks. It also shows Qwen3-30B-A3B reaching 27.5% on SWE-bench Verified with open training recipes.
The MI355X's 288GB of HBM3E per GPU gives it an edge on very large models like the 1.6T-parameter DeepSeek V4 Pro, but serving-stack maturity on ROCm remains the bottleneck at higher loads. Teams evaluating accelerator purchases for agentic inference can now compare AMD and NVIDIA on realistic coding-agent workloads rather than synthetic throughput numbers. All results run on ROCm nightly builds of vLLM and SGLang, so scores should improve as the software stack matures.
AMD 拿 1000 多张 MI355X 跑 MXFP8 预训练,还会讲 TorchAO 和 TorchTitan 的具体调优细节,搞训练的可以听听。
这份 44 天的性能追踪数据对做 AI 推理部署的团队很有价值,能直观对比 NVIDIA、AMD 和华为硬件的实际表现,建议点开看具体趋势。