Inworld 推出面向消费级 AI 应用的推理 API Inworld Inference
Inworld just launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.
Inworld 推出 Inworld Inference，一个面向消费级 AI 应用的 LLM 推理 API，支持 Gemma 4、GLM、DeepSeek 和 MiMo 等开源模型。官方称在 Gemma 4 26B 上首 token 中位延迟为 0.17 秒，对比 OpenRouter 上其他供应商中位值 0.61 秒快 3.6 倍；95 分位为 0.31 秒对 2.42 秒，快 7.8 倍。开发者还可设置首个模型失败或耗时过长时自动切换到备用模型。
查看原帖Inworld is your new favorite inference provider. We already process tens of trillions of tokens a month because we understand consumer AI different, and we've built our inference from the ground up for it. Today, the inference top consumer AI apps run on is opening up. https://t.co/jasm1DzweO
正文
当前显示原文，中文全文译文尚未就绪。
Inworld just launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.
> @inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.
> On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.
> At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.
> Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.