ProductsSelected

FlyDSL kernel DSL now supports PyTorch on AMD MI350 GPUs

Why we picked it

AMD MI350 support matters because GPU kernel tooling has historically centred on NVIDIA's stack, and this gives teams serving open models a Python-native path to tune kernels without CUDA-only tools. Benchmark and deployment engineers running vLLM on AMD accelerators can adopt the DSL directly from PyTorch's ecosystem and measure the 3.01x serving gain against their own baselines.

FlyDSL, an open source Python kernel DSL, now integrates with PyTorch on AMD MI350-series GPUs through torch.compile and eager mode. It delivers up to 1.68x geomean scaled GEMM kernel speedups on supported workloads. In end-to-end vLLM serving tests, FlyDSL achieved up to 3.01x serving speedups. The integration lets developers write Python-level kernels that run on AMD accelerators without leaving the PyTorch workflow.

Original · PyTorch

FlyDSL, an open source Python kernel DSL, now plugs into PyTorch on @AMD MI350-series GPUs via torch.compile and eager mode.

Up to 1.68x geomean scaled GEMM kernel speedups and up to 3.01x end-to-end #vLLM serving speedups.

Read more: https://t.co/ALYzbUkdAs https://t.co/SCu7Zk1W7j