How-to10月21日 13:14

只用 vLLM 就能复现 DeepSeek 的性能表现

Xianbao Qian@Xianbao_QIAN

Post

View the post

Why we picked it

想自己部署 DeepSeek 又嫌折腾的朋友看看，作者说 vLLM 一个工具就够了，不用堆一堆组件。

一篇帖子提出，仅靠 vLLM 这一个推理框架就足以复现 DeepSeek 的性能。vLLM 是目前主流的开源推理引擎，支持 DeepSeek 系列模型的部署。

Body

原文来自 Xianbao_QIAN 在 X 平台上的分享。

Original · Xianbao Qian

vLLM is all you need to reproduce DeepSeek’s performance.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "How-to" desk, focusing on China's AI industry and domestic foundation model ecosystem. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include vLLM, DeepSeek, 推理框架, 部署.

Source attribution: curated from Xianbao Qian (@Xianbao_QIAN).

#vLLM #DeepSeek #推理框架 #部署

Keep reading

Recent stories with the same tag or section

Models BuildersMulti-source71°06:38

Chinese contentvLLM 针对 Vera Rubin NVL72 优化 DeepSeek-V4.1-Flash，吞吐达 GB300 的 58 倍

vLLM 在新一代 NVIDIA 机架上把 DeepSeek-V4.1-Flash 跑到了每 GPU 170 万 tokens/s，比上一代 GB300 快 58 倍。自己部署 DeepSeek 的团队可以关注这套优化配置，硬件升级后的推理成本账值得重算一遍。

#DeepSeek #vLLM #Vera Rubin #开源模型

Event

Official accountvLLM@vllm_projectSource

Models BuildersMulti-sourceSelected05:32

Inkling 2 Small Runs on vLLM From Day Zero

Day-zero vLLM support plus single-node GB200 fit means operational cost of serving this model is far lower than typical 594B-scale deployments. Engineering teams running self-hosted inference should benchmark the 630 tok/s TP4 figure against their current MoE serving setups, since the DSpark speculator and NVFP4 experts are the levers behind it. Teams needing 1M-token multimodal context without multi-node clusters have a concrete new option to evaluate.

#Inkling 2 Small #Thinking Machines #vLLM #open-source models

Event

Official accountvLLM@vllm_projectSource

Models BuildersMulti-source76°05:25

Chinese contentvLLM 第一时间支持 Thinking Machines 的 Inkling-2-Small 模型

Thinking Machines 发了个 500B 的多模态 MoE，vLLM 发布当天就能跑，还带了 FP4 量化和投机解码优化。想自部署大模型的人可以看看集成细节，不用等闭源 API。

#Inkling-2-Small #vLLM #Thinking Machines Lab #MoE

Event

Official accountvLLM@vllm_projectSource

Industry Builders02:18

Chinese contentPyTorch Conference 北美 2026 全部 146 场演讲视频上线

PyTorch 官方把北美 2026 大会的 146 场演讲视频全放出来了，vLLM、DeepSpeed、Ray 这些项目的作者亲自讲训练和推理优化，做工程的人可以挑 kernel 和推理那几场看，比零散博客系统多了。

#PyTorch #vLLM #DeepSpeed #Ray

Official accountPyTorch@PyTorchSource

Products BuildersMulti-sourceSelected01:07

Helion compile-time heuristics beat handwritten Triton kernels

Compile-time kernel selection removes one of the biggest practical barriers to adopting Triton beyond a handful of expert engineers: the tuning sweep that precedes every deployment. Inference and serving teams on H100 hardware can swap handwritten reduction and attention kernels for Helion-generated ones and see gains, not just parity, against vLLM's baseline. The 27% margin over production CUDA code is the concrete comparison that should push platform teams to benchmark Helion on their own workloads.

#Helion #Triton #vLLM #H100

Event

Official accountPyTorch@PyTorchSource

Products BuildersSelected00:51

AI Agents Help Integrate SGLang with IBM Spyre in a Week

The notable point is the integration velocity: a 1,500-line plugin plus AI coding agents replaced what is typically a multi-month porting effort. Teams evaluating non-GPU accelerators for LLM inference can now consider IBM Spyre as a drop-in option with vLLM-parity performance. Engineering leaders building serving infrastructure should watch how plugin-based hardware abstraction in SGLang lowers the cost of supporting new silicon.

#SGLang #IBM Spyre #vLLM #PyTorch

Official accountPyTorch@PyTorchSource