Inworld 推出 Inworld Inference：面向消费级 AI 应用的低延迟推理 API
Inworld 新出的推理 API 主打快，Gemma 4 26B 首字延迟 0.17 秒，还带自动切备用模型，做陪伴或游戏 AI 的可以试试。
Inworld 发布 Inworld Inference，一个面向消费级 AI 应用的 LLM 推理 API，托管 Gemma 4、GLM、DeepSeek、MiMo 等开源模型。该服务针对 AI 导师、陪伴、游戏等场景优化模型运行速度。在 Gemma 4 26B 上，首 token 中位延迟为 0.17 秒，OpenRouter 上其他提供商的中位数为 0.61 秒，快 3.6 倍。95 分位延迟为 0.31 秒，对比其他提供商的 2.42 秒，快 7.8 倍。开发者还可设置备用模型，当首个模型失败或响应过慢时自动切换。
Inworld just launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.
> @inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.
> On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.
> At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.
> Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.
