Chinese contentRetell 营收年化破 1 亿美元，发布语音智能体模型 Tell 1
做语音智能体的朋友可以看看这个：Retell 年化收入过 1 亿美元了，还发了用 100 万小时客服通话训的 Tell 1，主打推理不卡顿。配套的 Conductor 能自动分析失败通话并给修复方案，比纯语音 API 更像一套呼叫中心方案。做企业电话客服自动化的团队值得对比测试。
AITOP | Global & ASEAN Southeast Asia AI Tech Media, Tools Directory & Startup Intelligence
Singapore · Friday, 13 November · Past 24 hours: 57 selected from 1650 stories
SubscribeDailyGoogle launches Decisions API as AI judgment becomes a product category
Nov 13
Stanford Researchers Introduce Speculative Self-Distillation for LLM Fine-Tuning
The non-obvious insight is that you do not have to choose between on-policy accuracy and training cost — selective teacher intervention gets both, plus measurably less forgetting. Developers and teams doing domain adaptation or continued fine-tuning can use SSD-style distillation to add new knowledge without degrading existing capabilities at a fraction of the token budget. Anyone benchmarking against standard on-policy distillation pipelines should compare training time and retention metrics directly.
Vercel launches UI SDK for agent-driven interface generation
The shift implied here moves value from opinionated component libraries down to low-level primitives that agents compose themselves, which could reshape how frontend tooling is built and priced. Teams building agent workflows or evaluating whether shadcn-style libraries still fit their stack should watch how the SDK's primitives perform in practice. Vercel's reach in the Next.js ecosystem means this framing will likely influence tooling decisions well beyond its own platform.
Databricks Genie Plugin Brings Business Context into ChatGPT
What changes is where enterprise analytics happens: governed, ontology-aware answers now sit inside ChatGPT rather than only in Databricks' own workspace. Data and analytics teams at enterprises already on Databricks can pilot self-service querying for business users, while OpenAI gains an enterprise anchor. Teams in ASEAN and China markets relying on ChatGPT for work should check whether their region and data governance rules permit routing queries through this plugin.
Gemini 4 Hydrogen ranks #4 in Agent Arena knowledge work
The non-obvious point is that overall leaderboard position can mislead: Hydrogen beats three higher-ranked models once tasks are filtered to knowledge work. Engineering leads and product teams running agentic assistants should compare models on their actual task mix rather than overall rank, using category-level Arena data like this. It also gives Google DeepMind a concrete speed-plus-quality benchmark against Anthropic's and OpenAI's Max-tier offerings.
LlamaIndex launches ParseBench-2 benchmark and OCRia-1.5 parsing models
Benchmark design that weights errors by severity rather than raw accuracy changes how OCR vendors will be ranked and evaluated going forward. Teams building document ingestion pipelines, RAG systems, or enterprise data extraction can use ParseBench-2 to compare the 150+ benchmarked OCR solutions, and LlamaParse users get OCRia-1.5 immediately. If you currently evaluate with OmniDocBench or LLM-judge methods, this offers a third methodology grounded in human-judgment alignment.
Amazon Bedrock and LiteLLM build self-service LLM gateway
The practical takeaway is that OpenAI-compatible gateways are becoming the default abstraction layer for enterprises, letting internal tools switch between Bedrock, OpenAI or self-hosted models with a base-URL change. Platform engineers and ML infrastructure teams should evaluate this recipe when their organisation needs quota isolation and cost attribution without building proxy infrastructure from scratch. Compared with running raw Bedrock integrations per team, this approach trades a small latency overhead for centralised governance. Teams in ASEAN and China markets serving multi-region AWS workloads can adapt the same pattern to their local Bedrock endpoints.
CoreWeave webinar on hot-swapping RL checkpoints in production
The non-obvious point is that RL cadence, not compute size, becomes the serving bottleneck once weights update every few hours, and hot-loading removes the downtime tradeoff. ML platform engineers and inference teams running post-training pipelines should attend to copy the Dynamo and RL Rollouts setup directly, including cost figures. Comparing on-policy weight transition approaches before committing to an orchestration stack could save a costly rework later.
SteerDistill Quantizes LLM Agents via Closed-Loop Teacher Steering
The non-obvious point is that the teacher remains involved after deployment-style compression, correcting the student agent inside its execution loop instead of only at training time. Teams deploying agents on consumer GPUs or edge devices should evaluate whether this steering loop cuts their inference bill without breaking tool-use chains. Compared with static quantization pipelines like plain GPTQ-style post-training, the closed-loop approach targets the multi-step drift problem specific to agents.
SGLang Consortium formed with NVIDIA, AMD, Google and Meta
Hardware vendors co-funding a single open-source inference engine reduces the risk that serving optimizations remain locked to one chip ecosystem, which matters for teams planning multi-vendor GPU fleets. Engineering leads running large-scale inference can track the consortium's roadmap to anticipate support for new models and distributed serving features. Organizations in Southeast Asia building inference capacity on heterogeneous hardware will benefit from upstream optimizations landing in SGLang rather than vendor-specific forks.
LMSYS releases SGLang v1.0 and Miles v0.2 at SGLang Summit
The pairing matters: a hardened v1.0 inference engine plus a production-focused RL framework gives teams a single open-source alternative to closed serving and post-training stacks. Engineers building agent or chat products on self-hosted GPUs can benchmark SGLang v1.0 against vLLM for throughput and memory gains. Teams running RL post-training can evaluate Miles v0.2 for their specific hardware mix rather than stitching together ad-hoc pipelines.
