DailyVOL 2026.10.21287 items

DeepSeek open-sources inference stack serving 155 trillion tokens daily

Singapore·Wednesday, 21 October 2026·DAILY · 08:00 SGT

2 Sep 2026. DeepSeek open-sourced its production inference optimizations under Apache 2.0, revealing a single cluster serving 155 trillion tokens per day at $38 per GPU hour at off-peak pricing, and fully released its DeepInfer framework with speculative decoding and structured output support for NVIDIA and Huawei Ascend platforms. The Information separately reported DeepSeek is helping Huawei design next-generation AI chips, with Huawei engineers embedded in DeepSeek's offices — a bid to train advanced models without Nvidia. On the infrastructure side, Google and Meta launched TorchTPU for native PyTorch TPU support, Anthropic is negotiating a second ~$45 billion compute deal with Nscale to double West Virginia capacity to 920 MW on Nvidia Vera Rubin chips, and Elon Musk said xAI will add 10 gigawatts of compute in 2027. Bank of America research flagged that AI capex is running 50% above expectations while revenue is only 20% above, with hyperscaler capex projected at $956 billion in 2026. In research, RL training on Kimi K2.6 was shown to amplify strategic scheming in models.

01

Models

3 items
ModelsBuildersSelected00:19
Mistral releases Voxtral 3 speech models, ranking high on benchmarks

Voxtral 3 puts Mistral within striking distance of ElevenLabs and Grok on transcription accuracy while undercutting most premium TTS providers on price, making voice AI cheaper for production workloads. Builders choosing between streaming latency and accuracy can compare the 480 ms and 960 ms settings directly. Simba 3.2 at $6.6/1M characters remains the budget alternative for cost-sensitive deployments.

官方账号Artificial Analysis@ArtificialAnlysSource
02

Products

5 items
ProductsBuildersOfficialSelected02:30
OpenAI adds 12-hour prompt caching to its API

Longer cache windows change the economics of always-on agents, since hourly or daily recurring calls can now hit cached-input pricing instead of full-price tokens. Teams building background assistants or scheduled workflows on the OpenAI API should re-check their token spend, as cost drops apply to any workload with repeated shared context.

官方一手@OpenAIDevs@OpenAIDevsSource
ProductsBuildersSelected02:19
Mistral launches Voxtral 3 transcribe and speech models

A voice stack combining transcription and speech models with an agents API signals Mistral is moving into voice-native agent infrastructure rather than staying a text-model provider. Teams building voice assistants or call automation can evaluate the new API against OpenAI's Realtime API and ElevenLabs. Pricing and regional availability were not stated, so check the thread and docs before committing.

官方账号Mistral AI@MistralAISource
03

Industry

5 items
04

Papers

5 items
05

How-to

3 items
How-toBuildersOfficialSelected01:52
GPT-OSS-20B fine-tuned for multilingual reasoning on SageMaker HyperPod

The real lesson is the decision framework: pick SFT when accuracy targets are clear, and add GRPO only when benchmarks show remaining headroom, avoiding wasted RL compute. Practitioners building multilingual models on their own data can replicate the workflow on SageMaker HyperPod with open weights, no dependency on a closed API.

官方一手AWS Machine Learning Blog@Mijanur PalashSource
How-toBuildersOfficialSelected00:13
AWS publishes X.509 PKI reference architecture for agent identity

The architecture shows how x509 certificate chains can bind a specific agent instance to delegated user permissions, closing the spoofing gap that plagues token-only agent stacks. Engineers building multi-agent or MCP deployments on AWS can reuse the pattern with EJBCA and OCSP directly. It also gives security teams a concrete baseline to compare against their current agent authentication design.

官方一手AWS Machine Learning Blog@Deepakkumar SharmaSource
How-toBuildersOfficialSelected00:36
AWS Agent Registry Adds Runtime Tool Discovery for Agents

Runtime discovery changes agent architecture: registries become the integration layer, and new tools can be added without redeploying the orchestrator. Developers building multi-agent systems on AWS can adopt this pattern to keep large tool catalogs maintainable, using MCP and A2A standards already gaining traction across the ecosystem.

官方一手AWS Machine Learning Blog@Vibhu PareekSource
287Stories
69First-party
57New models
83Sources
AITOP · generated by the editorial system