#PyTorch SDPA

1 stories · 1 in 7 days · 1 in 30 days

CACPU 1 Llama-3.1-8B 1 SGLang 1 推理优化 1

Stories, products and papers tagged "PyTorch SDPA", newest first.

Oct 30

Papers Builders10:48

Chinese contentCACPU：CPU 端因果注意力内核，比 PyTorch SDPA 快 2.01 倍

多智能体把 GPU 打满时，这篇论文教你怎么用 CPU 跑预填充，比 PyTorch SDPA 快 2 倍，还接进了 SGLang。

#CACPU #SGLang #PyTorch SDPA #Llama-3.1-8B

arXiv cs.LG@Kwun Fung Lau et al. (4)Source