Latest

The cost crossover at 6.8K tokens/s/chip reframes the Ascend-versus-Blackwell debate from raw benchmark losses to workload-dependent economics, suggesting DeepSeek could run its API on a sub-US$1B Blackwell cluster while pivoting post-training to Ascend. Practitioners tracking inference infrastructure or Huawei's CANN ecosystem get a rare concrete per-chip price and throughput comparison. The proposed 128-chip Ascend supernode topology has no Nvidia equivalent, which matters for anyone planning large-scale decode deployments.

Teortaxes@teortaxesTex11 sourcesSource

Open-source inference stacks closing the gap with a lab's proprietary serving setup changes the economics of self-hosting large MoE models. Teams weighing DeepSeek's API against running their own GPUs can use these Wide-EP and EPLB results to estimate revenue per GPU at off-peak prices. The GB200 and GB300 benchmarks also give infrastructure planners concrete throughput targets for the latest NVIDIA hardware.

官方账号vLLM@vllm_project7 sourcesSource

The back-of-envelope math suggests DeepSeek's RL training pipeline is compute-bound at the GPU level, not CPU-bound, which changes how analysts should read its published infrastructure claims. Investors and policy watchers tracking US export-control impact on Chinese labs can use the 3,000-GPU figure as a yardstick for scaling bottlenecks. Compare it with NVIDIA Blackwell allocation tiers announced for US hyperscalers.

Teortaxes@teortaxesTexSource

The same serving stack now optimises both NVIDIA and AMD paths, giving operators a concrete reason to benchmark MI355X deployments against GB300 rather than defaulting to CUDA. Teams running agentic inference traces can enable the mode through SGLang and expect P90 latency gains without changing models. The plugin system also means third-party kernels — starting with GLM-5.3, K3, and MiniMax M3 — will arrive without waiting for a core release.

官方账号LMSYS Org (SGLang)@lmsysorg11 sourcesSource

Efficiency is the headline: the model used ~189M output tokens versus 324M for GLM-5.3-Flash, so low cost comes from token frugality as much as pricing. Its 93% hallucination rate on AA-Omniscience means teams should add verification layers for factual workloads. An open-weights release on 23 October 2026 would make it directly comparable with DeepSeek's open models for ASEAN startups building on local hosting.

官方账号Artificial Analysis@ArtificialAnlys6 sourcesSource

Self-feedback reinforcement learning that targets whole-project output, not single-file answers, signals a shift in coding benchmarks toward multi-file, runnable deliverables. Developers evaluating open-weight models for end-to-end scaffolding can compare V4.1-Flash-1017 against Claude and GPT coding models on game and 3D tasks before committing to a stack.

AI Will@FinanceYF5Source