Primary sourcevLLM
View sourceEvent ·Multi-source
vLLM 生态在 TPU 上的进展获 SemiAnalysis 关注
vLLM 官方转发 SemiAnalysis 的分析文章,重点介绍其 TPU 生态工作。其中 Kimi K3 的 megakernel 和 vLLM TorchTPU 支撑了 AgentX 上 GLM-5.2、Qwen3.5 397B 和 Kimi K3 三个模型的推理成绩。vLLM 同时感谢了 @inferact 和 Google Cloud 在 TPU 性能优化上的推动。
Current read
vLLM 官方转了篇 TPU 推理生态的分析,Kimi K3、GLM-5.2、Qwen3.5 都跑在上面,做推理部署的可以看看。
6 sources51° AI heatLast updated 2026/11/5 19:30:03
Evidence
6 sourcesRelated source 1Artificial Analysis
View sourceRelated source 2Thomas Wolf
View sourceRelated source 3arXiv cs.LG
View sourceRelated source 4智源研究院 BAAI
View sourceRelated source 5rohanpaul_ai
View sourceConflict check
Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.