Latest

The cost crossover at 6.8K tokens/s/chip reframes the Ascend-versus-Blackwell debate from raw benchmark losses to workload-dependent economics, suggesting DeepSeek could run its API on a sub-US$1B Blackwell cluster while pivoting post-training to Ascend. Practitioners tracking inference infrastructure or Huawei's CANN ecosystem get a rare concrete per-chip price and throughput comparison. The proposed 128-chip Ascend supernode topology has no Nvidia equivalent, which matters for anyone planning large-scale decode deployments.

Teortaxes@teortaxesTex11 sourcesSource

Open-source inference stacks closing the gap with a lab's proprietary serving setup changes the economics of self-hosting large MoE models. Teams weighing DeepSeek's API against running their own GPUs can use these Wide-EP and EPLB results to estimate revenue per GPU at off-peak prices. The GB200 and GB300 benchmarks also give infrastructure planners concrete throughput targets for the latest NVIDIA hardware.

官方账号vLLM@vllm_project7 sourcesSource

Voxtral 3 puts Mistral within striking distance of ElevenLabs and Grok on transcription accuracy while undercutting most premium TTS providers on price, making voice AI cheaper for production workloads. Builders choosing between streaming latency and accuracy can compare the 480 ms and 960 ms settings directly. Simba 3.2 at $6.6/1M characters remains the budget alternative for cost-sensitive deployments.

官方账号Artificial Analysis@ArtificialAnlysSource

The back-of-envelope math suggests DeepSeek's RL training pipeline is compute-bound at the GPU level, not CPU-bound, which changes how analysts should read its published infrastructure claims. Investors and policy watchers tracking US export-control impact on Chinese labs can use the 3,000-GPU figure as a yardstick for scaling bottlenecks. Compare it with NVIDIA Blackwell allocation tiers announced for US hyperscalers.

Teortaxes@teortaxesTexSource

A 0.5B model beating much larger commercial systems on pronunciation suggests small, MIT-licensed TTS can now be self-hosted for production voice applications at minimal compute cost. Developers building voice agents or dubbing pipelines in the region can download both variants from Hugging Face and run them locally, avoiding per-character API fees from providers like ElevenLabs. The main trade-off is that closed models still lead overall, with Ming-3.0-tts only #13 on Controlled Voice.

官方账号Artificial Analysis@ArtificialAnlys5 sourcesSource

The same serving stack now optimises both NVIDIA and AMD paths, giving operators a concrete reason to benchmark MI355X deployments against GB300 rather than defaulting to CUDA. Teams running agentic inference traces can enable the mode through SGLang and expect P90 latency gains without changing models. The plugin system also means third-party kernels — starting with GLM-5.3, K3, and MiniMax M3 — will arrive without waiting for a core release.

官方账号LMSYS Org (SGLang)@lmsysorg11 sourcesSource

Efficiency is the headline: the model used ~189M output tokens versus 324M for GLM-5.3-Flash, so low cost comes from token frugality as much as pricing. Its 93% hallucination rate on AA-Omniscience means teams should add verification layers for factual workloads. An open-weights release on 23 October 2026 would make it directly comparable with DeepSeek's open models for ASEAN startups building on local hosting.

官方账号Artificial Analysis@ArtificialAnlys6 sourcesSource