#Pallas kernels

1 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "Pallas kernels", newest first.
10月21日
ProductsBuildersSelected01:17
vLLM TorchTPU backend brings Google Cloud TPUs into vLLM ecosystem

Serving infrastructure built around NVIDIA GPUs now has a maintained TPU path, lowering the switching cost for teams that want Google's accelerator pricing and capacity. Contributors can apply for the free TPU pool to test and port models. Practitioners running vLLM in production should evaluate TPU serving costs against their current GPU fleet.

Xianbao Qian@Xianbao_QIANSource