Event ·Multi-source

DeepSeek 开源推理框架 DeepInfer,支持 V4.1 Flash 与昇腾 950

DeepSeek 在 GitHub 上以 Apache 2.0 协议开源推理框架 DeepInfer,支持 DeepSeek-V4.1-Flash,硬件覆盖 NVIDIA SM100 GPU 与华为昇腾 950 NPU。框架包含草稿 token 校验调度 DSpark、滑动窗口有界重放和异步调度等优化,结构化输出支持正则、JSON Schema 和 EBNF 约束。官方性能测试条件为预填充 4 张 SM100、解码 64 张,且目前仅提供离线推理,KV 缓存与负载均衡等在线服务组件未包含。该帖在 Hacker News 获得 2104 points 和 821 条评论。

Current read

DeepSeek 把自家生产环境用的推理框架开源了,昇腾 950 也能跑,部署推理的可以看看 README 里的优化实现。

11 sources77° AI heatLast updated 2026/10/21 00:16:33

Evidence

11 sources
Primary sourceSuperTechFans
View source
Related source 2marktechpost
View source
Related source 4Teortaxes
View source
Related source 5Yuchen Jin
View source
Related source 6LMSYS Org (SGLang)
View source
Related source 7@atomic_chat_hq
View source
Related source 8Tech in Asia
View source
Related source 9kimmonismus
View source
Related source 10Xianbao Qian
View source

Conflict check

Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.