Inworld launches Inference service for consumer AI
Inworld has launched Inworld Inference, an inference service built for consumer AI applications and now open to all developers. The company says that on p95 time to first token, Gemma 4 26B is 7.8 times faster than the median OpenRouter provider, with input priced at $0.07 per 1M input tokens.
Why it matters: The article breaks down the latency and cost drivers of a conversational AI turn, from time to first token and caching to routing, and can be used to compare inference service options for conversational AI.