Primary sourceSuperTechFans
View sourceEvent ·Multi-source
DeepSeek 开源推理框架 DeepInfer,支持 V4.1 Flash 与昇腾 950
DeepSeek 在 GitHub 上以 Apache 2.0 协议开源推理框架 DeepInfer,支持 DeepSeek-V4.1-Flash,硬件覆盖 NVIDIA SM100 GPU 与华为昇腾 950 NPU。框架包含草稿 token 校验调度 DSpark、滑动窗口有界重放和异步调度等优化,结构化输出支持正则、JSON Schema 和 EBNF 约束。官方性能测试条件为预填充 4 张 SM100、解码 64 张,且目前仅提供离线推理,KV 缓存与负载均衡等在线服务组件未包含。该帖在 Hacker News 获得 2104 points 和 821 条评论。
Current read
DeepSeek 把自家生产环境用的推理框架开源了,昇腾 950 也能跑,部署推理的可以看看 README 里的优化实现。
11 sources77° AI heatLast updated 2026/10/21 00:16:33
Evidence
11 sourcesRelated source 1berryxia
View sourceRelated source 2marktechpost
View sourceRelated source 3AIGCLINK
View sourceRelated source 4Teortaxes
View sourceRelated source 5Yuchen Jin
View sourceRelated source 6LMSYS Org (SGLang)
View sourceRelated source 7@atomic_chat_hq
View sourceRelated source 8Tech in Asia
View sourceRelated source 9kimmonismus
View sourceRelated source 10Xianbao Qian
View sourceConflict check
Dedup data only shows that these sources discuss the same event, not that they agree. There is no structured supporting or refuting evidence yet, so no conflict is inferred automatically.