Event ·Multi-source

DeepSeek 完全开源内部推理框架 DeepInfer

DeepSeek 宣布将内部推理框架 DeepInfer 完全开源，配套开源 deepseek-recipe 编码/解码组件。DeepInfer 支持分布式推理、投机解码、SWA Bounded Replay、结构化输出，兼容 NVIDIA 和华为昇腾平台。该框架已用于 DeepSeek V4.1 Flash 的大规模推理服务，官方 API 的处理逻辑也与开源组件保持一致。后续新模型的推理代码和优化将持续在该仓库发布。

Current read

DeepSeek 把自家跑 V4.1 Flash 的推理框架 DeepInfer 开源了，支持英伟达和昇腾双平台，自建部署的朋友可以直接拿去用。

11 sources87° AI heatLast updated 2026/10/20 10:38:58

Evidence

11 sources

Primary sourceTeortaxes

2026/10/20 10:38:58View source

Related source 1berryxia

2026/10/20 11:34:11View source

Related source 2SuperTechFans

2026/10/21 00:16:33View source

Related source 3@atomic_chat_hq

2026/10/20 12:42:02View source

Related source 4marktechpost

2026/10/20 14:31:59View source

Related source 5kimmonismus

2026/10/20 10:26:39View source

Related source 6Tech in Asia

2026/10/21 05:58:27View source

Related source 7Yuchen Jin

2026/10/20 17:05:36View source

Related source 8shao__meng

2026/10/18 13:43:31View source

Related source 9Thomas Wolf

2026/10/18 14:34:40View source

Related source 10LMSYS Org (SGLang)

2026/10/20 00:39:06View source

Conflict check

Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.

Open the story