Latest

Every published item, in order · 25 items
Nov 4
Nov 3
Oct 30
Oct 22
Oct 20
ProductsBuildersMulti-sourceSelected08:42
SGLang Low-Latency Mode Launches with NVIDIA and AMD Support

The same serving stack now optimises both NVIDIA and AMD paths, giving operators a concrete reason to benchmark MI355X deployments against GB300 rather than defaulting to CUDA. Teams running agentic inference traces can enable the mode through SGLang and expect P90 latency gains without changing models. The plugin system also means third-party kernels — starting with GLM-5.3, K3, and MiniMax M3 — will arrive without waiting for a core release.

Event
官方账号LMSYS Org (SGLang)@lmsysorg11 sourcesSource
Oct 16
Oct 14
ProductsBuildersMulti-sourceSelected03:25
Artificial Analysis Adds Cache Hit Rates and Cost per Task

Cache pricing, not headline token rates, is now the dominant variable in agentic inference cost, so the cheapest sticker price can be up to 9x more expensive per task. Teams running long multi-turn coding agents can use these published hit rates and per-provider Cost per Task figures to pick endpoints and negotiate cache discounts. Z AI's first-party API hits 100% cache hit rate, a useful benchmark when comparing open-weights hosting options.

Event
官方账号Artificial Analysis@ArtificialAnlys4 sourcesSource
Oct 12
Oct 10
ProductsBuildersMulti-sourceSelected73°08:06
Tinker cuts long-context token prices

This price reduction makes long-context RL training and evaluation more accessible, potentially accelerating the development of specialized agent models. Developers building intelligent systems can now run more iterations with the same budget, while researchers can evaluate models on longer contexts without prohibitive costs.

Event
elvis@omarsar07 sourcesSource
Oct 7
Oct 4
ProductsBuildersMulti-sourceSelected04:18
Prime Intellect launches Prime Inference serving GLM-5.3 on vLLM

Serving agentic workloads reliably is a systems problem beyond raw token throughput, and this launch shows how topology and scheduler design affect tool-call reliability. Practitioners building agent infrastructure can study the approach or evaluate Prime Inference against self-hosted vLLM deployments. GLM-5.3, a Zhipu (Z.ai) model, being served at scale also signals growing demand for open Chinese models in Western inference stacks.

Event
官方账号vLLM@vllm_project5 sourcesSource
Oct 2
Oct 1
Sep 30
Sep 19
Sep 17
AITOP16:09
Anthropic拟10月在新加坡设亚太第五个办事处 开...

Anthropic拟10月在新加坡设亚太第五个办事处 开放本地招聘 数据显示,按人口比例计算,新加坡的Claude.ai使用水平在121个国家中排名第二。 我们观察到,人工智能公司Anthropic计划于10月在新加坡设立其亚太地区的第五…

AITOPRead
Sep 14
Sep 5
Sep 4
Sep 2
Aug 29
Aug 26
Aug 16
Aug 13
Aug 7
AITOP17:04
出口结构剧变:中国卖给世界的,不再是产品而是解法

中国出口"新新三样":从打火机到爬墙机器人,世界不再只是买便宜货 我们观察到一组清晰的数据信号:中国出口的"新新三样"已经从过去的服装、家具、家电,换成机器人、AI模型和创新药物。这不是产业升级的修辞游戏,而是发生在澳大利亚和巴西的实证样…

AITOPRead
Aug 2